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iNTRgsuerioN 

Public Pol ley Analysis (PA 812) provides knowledge and skills necessary 
or understanding, formulating, and iiiipleniehting public policies. The course 
also helps to develop conceptual , methodological and analytic skills essential 
to students pursuing a degree program in Public Administration. It seeks 
to present and develop a variety of tools which will enable you to under- 
stand and analyze strategic or "critical" decision, by which we mean major 
public choices that affect the regulation, distribution, and redistribution 
of societal resources, e.g., educational opportunity, medical care, municipal 
services, and natural resources. 

The essential difference between this course and others that you may 
complete during your program of studies is that Public Policy Analysis 
focuses on fflg^jor social problems such as uhempl bymeht , poverty, inequality, 
discrimihatibri, criitie, and drag and alcohol addiction. By contrast other 
courses in the curriculum emphasize the successful performance of a variety 
of management functions (personnel , finance, budgeting, conmuni cations, 
etc.) which contribute to productivity, efficiency and program effectiveness. 
Despite their obvious importance these are essentially routine managerial 
p roblems that seldom involve major public choices concerning the regulation, 
distribution, and redistribution of societal resources. 

Public Policy Analysis has no particular prerequisites; it is designed 
for students with widely differing practical experiences and educational 
backgrounds. Course materials have been written so that their objectives 
and content may be readily grasped and perhaps even mastered by any student 
who makes a serious coimiitment of time and energy to the cbrhpietioh of the 
course. 

The central purposes of the course are simple and straightforward: 

(1) to acqui-, ?! an understanding of the essential characteristics of the 
process of policy formation and implementation in public brgahizatibhs; and 

(2) to acquire concejDtUal , methodological, and analytical skills necessary for 
making appropriate choices among different policy alterntatives. The 
accomplishment of these two broad aims is relevant for three audiences 
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at once: public policy practiti oners j targets of public policies and 
prograrns* and citizens whose tax monies and trust support practitibriers ^ 
policies, and programs. 

The claim that the accomplishment of these aims is relevant to each 
of these three groups is based on several assumptions that should be 
made as explicit as possible at the outset. First, it is my firm impression 
that the study and practice of policy formation—along with public adminis- 
tration in general ---is and has been retarded by certain myths, the most 
irnportarit of which Is that of "insiders"- and "outsiders-"* For the university 
based social scientist who has chosen a career of teaching and research in 
public* affairs the public policymaker is often regarded as an "outsider," 
a "practitioner*" who is not privy to the kinds of essential theoretical 
knowledge that is generated within the academic cdriinuhity. By the same 
token the practitioner^ whose business is to formulate and implement 
policies, likewise often regards the university-based social scientist as ah 
"outsider," an "acadenilc," who is unacquainted with the kinds of practical 
problems with which public managers most grapple daily thrbughdut their 
careers. Paradoxical ly* both groups are partially correct in their assess- 
ments of one another- This is precisely why their views may be described as 
inyi:hs > half-truths and distortions which make it possible to rationalize 
or justify one's own activities as ah "insider" while criticizing or dis- 
missing altogether ''outsiders" who are believed to be incompetent to par- 
take of privileged activities. 

This two-headed myth* found with great frequency in universities and 
public agencies alike, is responsible for at least two regrettable ten- 
dencies in contemporary society. On the one hand universities, including 
schools of public affairs and adiTiinistratioh, seem increasingly powerless 
to withstand the colonization of academic programs by influential prac- 
titioners (including legislators), whose one-sided demands for technically 



The conceptual imagery is borrowed from ah essay by Robert Mertbn, 
"Insiders and Outsiders: A Chapter in the Sociology of Knowledge," Varieties 
of j^ol it jc gl gxpr ^sj^^ ( Chi cago : University of Chicago Press, 
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exploitable knowledge threatens to undercut the university's role as 
social critic arid creative problem-solver.* On the other hahdi many social 
scientists within universities, confronted with pressures to become more 
"useful," "practical" or "applied," have reacted by reinstating the 
illusidh of the political innocence of science, thus reasserting their 
role as detached scientific observers and eschewing any form of direct 
invdlvemerit in societal problem-sol virig. The rise of such essentially 
reactionary notions provides a natural target for "practitioriers ," who 
rightly claim that there is little of practical importance being produced 
by "academies." For their part the "academics" coritiriue to assert, and 
rightly so, that "practitioners" are ill-equipped by training, experience, 
and temperaireht to generate the kinds of theory arid research which are a 
necessary coriditiori both of social criticisvn and of creative problem- 
solving. 

These contemporary teridericies coritribute in decisive? ways to a situa- 
tiori iri which little productive dialogue is possible. Under such circum- 
stances it also seeriis unlikely that there will be more than a few survivors 
of our contemporary malaise * urless some rather marked chariges are made 
in the way that "insiders" arid "outsiders" see themselves and one another. 
A first step in this direction is to recognize that much of what passes 
today for informed thirikirig about public affairs is routine ^ uncreative 
and sterile. "Academics" and "practitioners" alike are often captives of 
their owri riarrow experiences, which they regularly use as a justificatiori 
or pretext for claims that their shopworn or their parochial ideas are more^ 
"realistic" or "valid" than those of opponents. In short, the myth of 
"insiders" and "outsiders" provides a rationale to both groups to 
criticize everyone except themselves. 

This learning package proceeds from a conviction that it is possible 
to generate a productive dialogue between "insiders" and "outsiders," but 



This is not- to imply that unTversitier should ndt^ arid have not his- 
torically, produced technically exploitable knowledge as ori£ of several 
activities, including the passing on and criticism of cultural traditions 
arid poetical practices. See J. Habermas, Toward A Rat ional Soci^^ty: Stxt-- 
dent Pratest^, 
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without losing the essential contriButions of either toward the resolution 
of cbhtenipbrary policy pro51enis. Unavoidably^ this conviction leads to 
certain difficulties^ most important of which is that of placing sufficient 
emphasis both on technically exploitable knowledge (e.g. , cost-benefit 
analysis) and the development of concepts (e.g., dialectical inquiry) and 
skills (e.g., value clarification) which make it possible to criticize 
emerging cultural traditions and political practices, including "policy 
analysis" itself. That such difficulties will be resolved below is hd more 
likely or desirable than the prospect that "insiders" and "outsiders" will 
soon join ranks in a cortinon effort at social criticism and societal problem- 
solving. A dialogue, by definition, implies differences and even conflict. 
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eOURSE COMPONENTS 



There are four primary components of learning in this course: (1) the 
attached study guide; (2) bh-camptis workshops; (3) instructor contact; and 
(4) graded course assignments. Each of these components is explained below. 



Inmediately following this Course Guide you will find the Study Guide 
for PA 812. It is divided into six units, each of which contains various 
instructional elements which will facilitate your learning throughout the 
term. These instructional elements are described below. 



in each unit are presented at the beginning of the unit. Tz^ rhould 
carefully review these 'Terms and Concepts before reading the text. When 
you finish the text you should review these Terms and Concepts before com- 
pleting the Study Questions and Self-Testing Exercise for each unit. 

Learning Objectives . At the beginning of each unit you will also 
find a list of tearhing Objectives. Each objective is stated in behavioral 
terms so that you know exactly what is expected of you when you have completed 
each unit. Study these Learning Objectives carefully; dt is also a good 
idea to refer back to these frequently as yeu read the text. 

text . Each unit contains a written text that presents ideas and 
information necessary to achieve Learning Objectives and complete various 
tasks, the first unit is an introduction arid it is the foundation for 
the remainder of units you will complete during the course. Note that each 
unit contains a list of figures arid/br a list of tables wfiich help you to 
locate sources of data or ideas in the text easily. Each unit also contains 
an Overview that shows relatidriships between objectives, tasks, learning 
resources, and the types of evaluation used. As rioted above^ each urilt 
includes Key Terms arid Goricepts arid Learriirig Objectives. All units have 
several subsectidris which have titles written in capital letters (e.g. 
PUBLIC POLICY AND MODERN SOCIETY) . At the end of each unit you will 
find Refererices to works cited in the text, and finally, a set of Self- 
Testing Exercise, Assignments, and an Answer Key for the Self-testing Exercise. 
Each unit is interspersed with study questidris which will help you to focus 
your attention on signficant aspects of the unit. 





The most important Terms and Concepts used 



Qh^ Camp Us , Wot3 j-h^gs. 

It is strongly recorwended that you attend each of the three Workshops 
scheduled during th^ termr Although you will not be tested or evaluated 
on lectuFes or any other information given at these Workshops, you will 
find that contact with the instructor and his assistant at these sessions 
will help you to understand more fully the aims and content of the course. 
Each workshop will involve lectures, class probleSB and exercises, and 
extensive group discussion and. feedback. The schedule of workshops is 
provided in your Course Addendum, 

graded Cours.^ A.ssigjimenjbs 

At the ^nd of each module there is a written Assignment to be completed 
and mailed to m for grading. Assignments are the basis on which my assis- 
tant and I will evaluate your learning progress throughout the course. 
While each Assignment has a different form, they are all designed to 
evaluate the extent to which you have achieved the Learning Objectives for 
each module. Each of the six (6) assignments is worth 100 points- 

Submitting Assignrrents . When assignments are completed they should 
bt5 inailed to me at the address provided in the Course Addendum. 

Srad jnq_ As3 ignments > Your final grade will be based oh an average of 
the six (6) Assignments submitted thrbughbut the term. Since each assign- 
ment is weighted equally^ the total score for the course will be computed 
by adding th§ scores for all the assignments and dividing by six. This 
average score will be converted to letter grades according to the following 
system: 

A * 90 points and above 
B ^ 80-89 points 
C ^ 70-79 points 
D ^ 60-69 points 
f * below 50 points 
S ^ 75 points and above 
US ^ below 75 points 

Since one of my main interests in the course is helping you to develop 

and improve your knowledge and skills, I will use a bonus system which takes 

into account the degree to which you have improved during the course. The 

rule I will follow is this one: you will receive a bonus of two (2) points 

toward your final grade each time that you improve upon your previous mark 

by at least five (5) points. This means that you may earn as much as ten (10) 
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This course contains six units each of which has several subsections. 
When used as a regular course these units should be completed in numerical 
sequence. At the same time, units can be used independently in special 
work settings. Unit 1: The bogie of Public Policy Analysis establishes 
the framework for each of the succeeding fivc u'lits in the course. It 
is particularly important that Unit 1 be studied carefully and thoroughly, 
since it introduces key terms and concepts* definitions, arid relationships 
which provide the fouridatioh for the remainder of the activities you will 
complete in the course. Unit 1 outlines a logic of public policy analysis— i. 
a set of assumptions, principles, and rules that shape the ways we experience 
and think about public policies. 

An outline of each of the six units, together with their respective 
Subsections is provided below. 

1. THE LOGIC OF PUBLIC POLICY ANALYSIS 

Introduction--Public Policy and Modern 
Spciety--A Simple Model of Rationale 
Choice— Policy Analysis and Rational ity-- 
The Process of Policy Formation 



2. POLICY PROBLEMS 

Introduction --the Nature of Policy 
Prob1ems--Popular_arid Scientific Myths 
About. Pol icy Prdblems--The_Structure 
of Policy Prdbleros--Value Clarification 
iri Policy Arialysis 



3. POLICY OUTCOMES 

Iritroduetiori— The Role of Monitoring 
i ri Pol i cy Aria lys i s— Measu ri ng Pd 1 i cy 
Outcomes arid Actibris--Displayirig arid 
Iriterpreti ng Data--Approaches to 
Moriitoring--Some Fallacies of Measure- 
ment 



4. POLICY ALTERNATIVES 



Introductiori^-The Nature of Forecasting- 
Approaches to Forecasting— Forecasting: 
Strengths and Limitations 

viii 



extra points on your final average grade by demonstrating continuous 
improvement on the module assignments. For example^ eorisider tfie following 
hypothetical student who earned eight (8) extra points during the course. 
The student earned 65 points on the first assignment. Since she scored 
70 points on Assignment 2, she earned 2 bonus points (listed across from 
Assignment 1, below). You will also note that this student earned 80 points 
on Assignment 3 and only 75 points on Assignment 4. She was awarded no bonus 
points, and no bonus points were subtracted. 



Assignment 




Bomjs^ 


1 


65 


1 


2 


70 


2 


3 


80 


2 


4 


75 


0 


5 


83 


2 


6 


88 


2 


Average 


77.0 


8.0 



Course Grade = 77.8 + 8.0 = 85.0 (B) 



g^b^k on Assignments. A copy of each written assignment will be 
returned to you with a grade and consents on your answers. Please allow 
from 10-15 days between the time you post your assignment and your receipt 
of the graded copy. If you have any questions oh Written assignments, 
or If you wish to make ah appointment with me you can reach me by phone 
at the number listed in your Course Addendum. 
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• Ihtrt)duct1bn--The_Natur^ 
Recormnendatlon^ of Pol Icy 

Recornmendation--Systematic Analysis: 
Strengths and Limitations 



POLICY PERFORMANCE 
Introductign--Ey^^ 

Performance — Approaches to Evaluation 
Informatipn Utilization and Policy 
Development 
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INTRODUCTION 

The study of policymaking in modern societies presihts complex, 
demanding, and seemingly insoluble problems for policy analysts both 
inside and outside of government. For this reason it is desirable and 
even necessary that we use cbneeptual frameworks which simplify, formalize, 
and clarify our subject matter. The cdhCiptual framework introduced in 
this unit seeks, first of all, to simplify major elements of thi process 
of public policy formation. Paradoxically, however, the ultimate aim of 
this simplifying framework is to discern and appreciate the many-sided 
complexities of policymaking in what we will later describe as post- 
industrial policy ehvirohmehts. In other words thi framework, through 
purposeful simplification, makes it possible to discover and more fully 
understand some of the ways that this multidimehsibhal complexity is 
organized and, hence, intelligible to the human mind. 

The skeleton of bUr conceptual framework has been reproduced oh the 
cover page of this unit. The empty rectangles and ovals, together with 
their connecting arrows, represent basic elements in a framework ifor 
analyzing public policies. In this and sueeeedihg units we will apply 
and elaborate upon this conceptual framework. As you progress through 
these units you will develop skills in identifying, defining, and applying 
each of the framework's interdependent elements: pblicy-informatiorial 
components (rectangles); policy-analytic procedures (ovals); and policy- 
informatidhal transformations (arrows). In this unit we will begin by 
considering: (1) the nature of public policy in modern society; (2) major 
characteristics of a simple model of rational choice; (3) the relation- 
ships between policy analysis and different conceptions of rationality; 
and, finally, (4) basic elements in the process of public policy formation. 
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LEARNING OBJECTIVES 



After completing this module you should be able to: 

1. Explain and apply key concepts that constitute the "language" 
of policy analysis. 

2. Compare and contrast policies in terms of their authbrita- 
tivehesSi scope, and place within policy structures. 

3. Distinguish between policies according to their degree of: 
strategic or critical importance, their relation to questions 
of public accountability, and their relative autonomy. 

4. Identify the characteristics, consequences, arid implicatidris 
of post-industrial policy erivirbrimerits. 



5. Identify the assumptions of models of rational choice and 
their limitatibris. 

6. Compare arid cbritrast dialectical^ descriptive, prescriptive 
arid authoritarian modes of rational choice. 

7. Bistiriguish irajor types of rati6riality_acc6rdirig to the 
criteria by which decisions are assessed. 

8. Compare arid coritrast iritellectual, orgariizatiorial, an 
sociopolitical aspects of the process of policy formation. 

9. Distinguish TOthodSjexperi^ as bases for 
contending approaches to policy formation. 

id. Define pol icy- Info mat ionalcpm^^ 

procedures , and policy- informational transformations, and 
apply them to a policy of your choice. 
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KEY TERMS 


AND 


CONCEPTS 




Public Policy 




Policy Analysis 


• 


Issue-Area 


• 


Policy Process 




Policy Issue 




Rational Choice 




ru 1 1 1 jr rrOu icin 


• 


■ Disjointed Incremental ism 
Comprefiensive Rationality 




Pol icy Structure 
Pol icy Systan 


w 


ru 1 1 ^*y^ iTi TurTiia 1 1 una i 
Components 




Pol icy Environment 

Policy Actors 

Post industrial 
Pol icy Envirdnmerit 


m 

m 


Policy-Analytic Procedures 

Policy-Informational 
Transformations 




Rational ity 


i 


Policy Formulation 




Multiratidhality 


• 


Policy Implementation 
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OVERVIEW 



............ . . 

Objective 


Task 


Resource 


Evaluation 


1 . Explain and apply 
key concepts that 
constitute the 
language*' of 

nnl Sry rtn^l vsi s • 


Study Questions 
1.3,9 
Test Question 
9 


Unit 
Narrative 


Self 


Z. eompare and con- 
trast policies in 
terms of their 
authoritativeness, 
scope» and place 
within pol icy 
structures* 


Study Questions 
_ 2,4.5 
Test Questions 
1,3.4,6,16 


Unit 
Narrative 


Self 


3. Distinguish be- 
tween pol icies _^ 
according to their 
degree of strate-* 
gie or critical 
importance, their 
relation to ques- 
tibhs of public 
aceouritabil ity, 
and their relative 

a u iiuiiijf • 


Study Questions 

5,11 

Test Questions 
2,3,4,5,6 


• Unit 
Narrative 


Self 


4. identify the char- 
acteristics ^ conse- 
quences, and 
implications of 
post-indUstriai 
pol icy environ- 
ments • 


Study Questions 

6,7,8 
Test Questions 
7,8 


Unit 
Narrative 


Self 


5. Identify the__ 
assumptions of 
models of .rational 
choice and their 
limitations. 


Study Questions 
9,10,11.12,13 
14,15,16 

Test Questions 

10,11,12,13,14, 

15 

Unit Assignments 


Unit 
Narrative 

19 


Self 
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Objective 



Compare and coh-_ 
trast dialectical , 
descrlptivei 
prescriptive and 
authoritarian 
modes of rational 
choice in terms of 
their rel iance on 
methods , expe- 
rience, _and 
authority. 



Task 



Study Questions 
19,20,23 
Unit Assignments 



Distinguish the 
major types of 
rational ity 
according to the 
criteria by which 
decisions are 
assessed. 



StudyOuestions 
_ 24,25 
Test. Question 
10 

Unit Assignments 



8. Cqmpareand con- 
trast intellec- 
tual andsocial 
aspects of the 
process of pol icy 
information. 



Discuss methods , 
experience , and 
authority as bases 
for ^'disjointed 
iricrementalism" 
and "comprehensive 
rational ity" as 
two cohtehdihg 
approaches to 
policy information 



Study.Questibns 

8, 30,31 
Test Question 
15 



Resource 



_Unit 
Narrative 



Unit 
Narrative 



Evaluation 



Self and 
Instructor 



Study Questions 

21,22 
Test Questions 

18,19,20 
Jnit Assignments 



10. Define policy- 
informational com- 
pbnents, policy- 
analytic proce- 
dures i and pbl icy- 
informatidhal 
transfdrmatidris 
and apply them to 
processes df policy 
formation. 



Unit 
Narrative 



Unit 
Narrative 



Self and 
Instructor 



Self 



Study Questions 
17,26,27,28^29 
Test Question 
17 

Unit Assignments 



_Unit 
Narrative 

Self 



Self and_ 
Instructor 



Self and 
Instructor 



PUBLIC POLICY ANALYSIS 



puBLi.e PdLieY in mobern ssciety 



Every day there are literally thousands of policies analyzed, 
fbnrwlated and implemented in the United States and other modern 
societies. Some of these policies are private; some are public. Some 
affect you directly; others indirectly. But there are few policies so 
restricted in scope that they do not affect in some way you, your family, 
and your local coninunity. Gohsider, for example, the large number of 
public and private organizations which make and influence educational 
policies which affect learning opportunities available to university 
students. 

U.S. Congress _ _ 

U.S. Department-of Healthy Education and Welfare 
U.S. Office of Edtieatibn 

U.S. Departmeht of Rousing and Urban Development 

U.S. Ve te rani s i Admi n i s tr at ton : 

U.S. National Science Foundation 

Ebrmbhwealth of Pennsylvania 

Pennsylvania Bepartment of Education 

Allegheny County Cornmissioners 

ALCOA Foundation 

Hi] Imari iFbuhdatiori 

Mellon Fbuhdatibri 

Rbclcefeller Fbundation 

Ford Fbundation 



The above sample may be expanded dramatically if we include other 
levels of education^ other regions in the country, and other areas of 
policy, such as crime, drug addiction, taxation, emplbymerit, and social 
security, to riame only a few. Even when we narrow our focus to those 
policies developed by public organizations we are still left with a very 
large and complex problem^ given the structure of government and policy 
formation in modern societies such as the United States: 

The structure of the United States government 
ischaotjc. In addition to the federal government 
and the 50 states, _there are something like 
18,ddd_general -^purpose municipal ities ,_sligfitly 
fewer generaNpurpqse townships, more th^ 
3^dd0_ counties, and so many special-purpose 
governments that no one can claim even to 

Si 
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Bave counted them accurately. At^an iducated 
guess, there are at present some 92,000 tax- 
^eyylng governments in the country. A given 
citizen may be buried under a whole pyramid 
of governments (Grodzins^ 1966:7). 

The study of policy in modern societies is therefore cortiplex 
and demanding. Nevertheless* we can simplify our task at the 
outset by considering several important definitions, ones 
which help us to make some useful distinctions. As noted above, not 
all policies are public ones. A public policy is ah authoritative 
guide for carrying out governmental actions in national, state, regional^ 
and municipal jurisdictions. As compared with private policies, public 
policies are backed by the coercive force of public law, which means 
that legislative enactments and administrative regulations may be enforced 
by the police and ebUrts. Public policies also derive legitimacy from 
substantial (but always less than complete) support among the general 
populace. Further^ public policies affect all citizens within 
a given jurisdiction. None of these characteristics applies to private 
policies--for example, a large steel company's policy to relocate its 
facilities in another state— because such policies lack authority, 
coercive force, legitimacy, and scope of application in a given jurisdiction 
or territory, this is not to say that private policies may not have 
an important or even decisive impact on public problems^ rather, 
private policies are singly much more restricted in scope than public 
ones, even though the distinction between "public" and "private" is 
increasingly blurred as a consequence of the growing interdependence 
of societies. 

Another way of making distinctidhs among public policies is to 
define and specify the contexts in which they arise. Public policies 
may be grouped according to issue-areas , which are the particular 
functional contexts in which public actions are carried out. These 
functional contexts include national defense, foreign aid, health, 
education, welfare, public safety, transportation, revenue and 
taxation, social security ^ empldymenti economic development, and 
the environment. In each of these functional contexts a large number 
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of policy issues is generated every year. A ^lljzy issue is an actual 
or potential course of public action atSout which there is significant 
disagreement or conflict among important groups within a community. 
Policy issues are always associated with particular definitions of a 
policy problem held by different segments of a community. A p&^^y 
^gr^blgm, to adapt a defihitidh from political scientist Gharles Jones 
(JoheSi 1970:20) > is a human value or need^ self-identified or defined 
by others^ which may be satisfied through public action such that 
persons beyond those immediately cdncerped perceive themselves to be 
affected and engage in political action. Policy problems are therefore 
more specific than policy issues. 

A policy issue such as uhemplbyinerit involves significant disagreement 
among different groups: employees associations, corporations, labor 
unions, political parties, minority groups. Yet, there may be several 
different definitions of policy problems associated with the issue of 
unemployment. For th^ National Association of Manufacturers the issue 
of unemployment may linked to a definition of a policy problem which 
focuses oh the possible effects of reduced corporate income taxes on the 
expansion of investment, production, and jobs. For labor unions such as 
the AFt-eiO th^ issue of i^nemplbymeht may be connected with ah altogether 
different definition of the problem, one which emphasizes the possible 
effects of changes in corporate employment policies oh maintaining 
existing levels of employment and job security. Hence, the same policy 
issue often results in multiple and fuhdamehtally different defihitibhs 
of a policy proDlem and^ therefore^ of the range of appropriate courses 
of public action which may alleviate or resolve that problem. In other 
words, policy problems are dependent on the perceptions and values of 
different groups; while all groups may agree on the importance of an 
issue, they may differ radically in their perceptions of the problems 
connected with that issue. 

One final s§t of definitions will also help us to distinguish 
between different kinds of public policies. Here we are concerned 
with the relative importance of public policies— i.e. , some 
policies are mr^ important than others, depending on their 
position in a given policy structure. Policy structures are 
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hierarehically ordered levels of public action, ranging from major, 
secondriry, and functional policies to standard operating procedures 
and rules (Figure 1-1). A major-^4cy- deals with the overall goals of 
government^ a public orgahizatidn, or set of organizations; it may in- 
volve an assessment of long-term objectives and alternative societal futures, 
as well as guidelines for planning, coordinating, organizing, and evaluating 
discrete policies which are secondary or fuhctidhal in nature. Major 
policies include codes of ethics for publ ic employees and decisions to 
reorganize the types of activities performed by ah agency (e.g., to 
combine health, education, welfare, and environmental protection in one 
agencj^). Secondary policies include decisions to redefine target areas 
or client groups, e.g., by increasing the average annual income level 
that qualifies families for public assistance. Fun ct ional po 1 i c i es , by 
contrast, involve decisions about alternative approaches to budgeting 
and finance (e.g.^ zero-based budgeting), public relations (e.g., programs 
to advertise the availability of legal services j ^ persorinel (e.g.^ new 
forms of testing for entry into the public service), and research and 
development (e.g., the development of management ihfdrmatidri systems). 
Mihdr pdlicies typically involve decisions about the maintenance of 
public facilities, while standard operating procedures and rules govern 
agency procedures (e.g., inventory control) and employee behavior 
(e.g., vacations, overtime, use of agency automobiles). 
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Major Policies 



^ Secondary Policies 



* Functional Policies 



Minor Policies 



Standard Operating 
Procedures 



Rules 



. FIGURE 1-1 
Qr^niza^tlonal Pol i cy Striicture 



SOURCE; Adapted from Hodgetts and Wortman (1975:6) 
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In examining any policy structure several considerations must be 
kept in mind. First, each level of policy is dependent on the others, 
such that changes in a major policy are likely to affect other levels, 
including standard operating procedures and rules. Second, relation- 
ships arrong levels may differ according to the kinds of issues and 
problems under consideration. Some major policies may not be imple- 
mentable at lower levels. Consider, for example, the familiar case of 
the prohibition of alcoholic beversges in the United States in the 
1930's. Third, minor policies, standard operating procedures, and rules 
may affect major pol icies~e. g. , in those cases Where changes in rules 
governing employee overtime result in employee demands for union repre- 
sentation. Fourth, the scope and degree of Involvement in making and 
influencing policies at each level may differ from one organization to 
another. In a relatively Small program with less than 30 employees and 
a small clientele there may be a great deal of employee and citizieri 
participation in making policies at each level; a large program with 
several thousand employees is likely to be much less participative. 
Final ly^ as we proceed from the minor and functional to the secondary 
and major level, public organizations have less freedom to develop 
policies autonomously. Questions of public accountability therefore 
become more important as we proceed upward in the hierarchy. The 
complexity and interdependence of policy issues make it unlikely that 
a department or agency can act alone in developing policies at the 
major, secondary, functional and even minor level. One important con- 
sequence of this is that precisely those policies which are most 
"critical" or "strategic'* in importance—i.e. , those at the top of a 
policy structure--are also the most difficult to formulate and implement. 

So far we have not explicitly considered some of the possible inter- 
relationships aTOng elements of public pol icy defined above. Here it is 
useful to introduce a new concept, which is that of a policy system. A 
policy system is an interrelated set of elements which together govern 
the ways in which policy problems are acted upon by public organizations. 
Above we noted that in any given issue-area (e.g. ^ health) there are a 
variety of policy issues (e.g., medical care for the aged, the maintenance 
of standards in nursing homes^ alcoholism arid drug treatment). Each issue 



may result in multiple jDdlicy problems (e.g., alcoholism and drug addic- 
tion may be defined as a medical problem, a psychological problem, a social 
problem, or an economic problem)^ depending on which segment of a community 
is defining the problem in relation to given values arid needs. The 
definition of a policy prbHIem, therefore, depends on the involvement of 
particular policy actdrs- -i.e., persons or groups who exert some degree 
of influence on the ideritificatiori of problems in accordance with given 
needs or values, whether these are their own or those of some other group. 
Policy actors--e.g. , citizens' groups, labor unions, political parties, 
lobbies, government bureaus— respond in markedly different ways to the 
same set of events in a policy environment. A mlix:y erivirbnmerit is the 
specific context iri which events (e.g. ^ rising alcoholism and drug abuse) 
surrounding a particular issue occur. Public policies, which we have 
already defined above, assume different forms as a result of the involve- 
ment of different policy actors in various policy erivirbrimerits. Relation- 
ships between these three elements of a policy system are illustrated 
below in Figure 1-2. 
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FIGURE 1-2 
Elements Qf A Policy System 



SOURCE : Adapted from Dye (1975:6) and Coplin (1975:2). 
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In any policy system there are a number of possible relationships 
between these three elements. For example, acts of racial and sexual 
discrimination are important events in the policy environment of public 
agencies in the United States. Equal Employment Opportunity-Affirmative 
Action policies of federal ^ state, and municipal governments are designed 
to curb racial and sexual discrimination in hiring, promotion^ and 
wages, these policies affect and are affected by events (discriminatory 
acts) in the policy environment. Such events also affect policy actors 
(e.g., the U.S. Civil Service eormissiop, the U.S. Department of Health, 
Education, and Welfare, the National Association for the Advancement of 
Colored People), who define such events in different ways* depending 
upon the amount of informatioh available and its interpretation according 
to particular values and needs. There are different definitions of the 
policy problem^-e.g.i discrimination is defined as a prbblem of racist 
attitudes of employers, but also as a problem of inadequate educational 
opportunities for minorities. These competing definitions then result 
in different kinds of pol icy recorrmendatidns to resolve the problem. 
Whatever policy is adopted will result in different levels of satisfac- 
tion and support airrong different policy actors. In short, only by 
analyzing the relationships between the pol icy environment, policy 
actors, and public policies can we begin to understand the different ways 
that issues and problems are defined and acted upon by public organiza- 
tions. Table 1-1 illustrates some of the possible relationships between 
the three elements of a policy system and the definition of policy 
issues and problems. 

By how it should be clear that the study of public policy in modern 
societies is highly complex. It is also evident that the study of public 
policy becomes increasingly difficult as changes occur in the nature of 
policy environments. In the late twentieth century, for example, a series 
of rapid changes have created what we might call postindustrial policy 
^wironment- -i .e. , those settings in North America, Europe, Oceania, 
and Japan where the number, complexity, and critical importance of policy 
problems are growing at ah alarming and perhaps uncontrollable rate. In- 
deed, policy scientist Yehezkel Dror has stated this dilemma in the form 
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TABLE 1-1 

Relatjonslii'ps Df Policy Issues AfidJrol)lm 
To Elements Of Policy Systems 
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Policy Problem 
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FIGURE 1-3 

Projected Changes In -VaTue Profiles 
gf Americans^ 1969-19"5a 

SOURCE : Adapted from Rbdgetts and Wortman (1975:28). 

Note : this figure shows that_the strength of corrniftment to certain 
pairs of opposing values (e.g., war versus peace) is likely 
to change between 1969 and 1980. Points to the left and right 
of the zero^point indicate the degree of commitment to polar 
values along a continuum. For example, the continuum "hot- 
peace" shows_a commitment of .5 to "war" in 1969; the pro- 
jected commitment in 1980 has changed^ with a .5 commitment to 
"peace." The zero-point should be interpreted as ambivalence. 
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of a law: "While the difficulties and dangers of problems tend to increase 
at a geometric rate, the number of persons qualified to deal with these 
problems tends to increase at ah arithmetic rate" (bror^ 197i:2). 

There are several major characteristics of pdstindustrial policy 
environments which contribute both to the creation of the above problems, 
and also to their resolution. First, there has been a dramatic increase 
in the mutual dependence of public and private activities, both domes- 
tically and in international society. Second, a large number of unantici- 
pated social problems~e.g. , pollution and ecological degradation, rrental 
illness, urban squalor, crime, drug and alcohol addiction— have accom- 
panied policies of rapid and unlimited economic growth, industrialization 
and urbanization, third, there has been a steady increase in the average 
education of blue as well as white collar employees, one result of which 
is an increase in the number and influence of policy actors. Related to 
this is a rapid shift in the proportion of service workers, as compared 
to workers in industry and manufacturing, and a resultant change in the 
social value attached to work itself. Increasingly, workers seek satis- 
faction and fulfillment on the job, as well as through traditional family 
and community channels. Changes in social values are also evident in 
areas which were previously dominated by cdhservative and slowly changing 
traditions. Figure 1-3 illustrates projected changes in the value profiles 
of Americans in the period 1969-1980. 

Post industrial policy environments have also contributed to changes 
in the self-perceptions and roles of practicing public managers and 
policymakers. For example, the systematic analysis of public policy has 
acquired a measure of importance and value to society that was unknown 
in past periods. There has been a gradual increase in the involvement 
and influence of professional managers and policy analysts, together with 
growing societal expectations that experts with specialized technical 
knowledge will be able to resolve major social problems. Specialized 
methods of forecasting, evaluation, coordination, and control have been 
extended to formerly nbh-techhical areas of politics, culture, and social 
relations. In short, at the very moment when policy problem^ are in- 
creasing geometrically, vigorous efforts are being made to use technical 
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knowledge to subject postindustrial policy envirohitients to more rational 
modes of planning, control, and overall societal direction. As we shall 
see, such efforts raise fundamental ethical questions about the meaning 
of "rational" public action. 



STUDY QUESTIONS 



Answer each of the questions that follow: 

1. ' Define the following terms: 
public policy: 

issue-area: 

policy issue: 

policy problem: 

policy structure: 

policy actors: 

policy environment: 



2. Compare and contrast public policies with those formulated and 
applied in the private sector. 
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3. Distinguish between policy Issues and policy problems, providing 
examples of each. 



4, provide one illustration each of the policies formulated at 
each of the six levels within pal icy structures. 



How can the analysis of levels within pbliey structures help 
to distinguish between "strategic" or "critical" decisions, 
on the one hand, and "routine" decisions on the other? 



6. Which of the specified cbhditibhs associate^ with post- 
industrial policy environments create new problems for 
policymakers? Which of theise conditions are a response to 
policy problems? 



^4 
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7. Reconsider the coriditibris of pbstihdustnal policy erivirbriments. 
Is the distinetibn between ebnditions which create problems 
and those which are a response to problems a clear one? Which 
"responses" might actually contribute to the creation of 
problems? 
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The study of public policy is essentially tfie study of rational 
choice. When we inquire into the nature and cdhsequehces if a policy 
we seeR to understand the reasons why particular courses of action 
are chosen. When a policy achieves its objectives by resolving 
such problems as inflation, unemployment, or inadequate standards of 
living we usually think of it as ''rational," meaning that the appropriate 
course of action has been chosen to alleviate the problem. By contrast, 
a policy which fails to achieve such objectives— either because the 
courses of action chosen were the wrong ones, or because the actions 
created more problems than they resolved— is normally thought to be 
"irrational." there is also a special category of actions which are 
neither rational nor irrational, since there are no specific reasons 
or choices which guided the actions. The most appropriate term to describe 
this category is "non-rational;" a large number of actions occur every 
day out of habit, custom, routine, or a simple lack of awareness of 
relationships between ends and means. 

Habitual, customary, routine, or unconscious actions are incon- 
sistent with any commbnly understood meaning of "policy." This is 
because policy has the cormon meaning of cohscious and goalrdirected 
behavior. While it is difficult to imagine a policy based on m reasons 
and no choices i the idea of "non-ratidnal" policymaking does raise a 
nurrSer of important problems. When complex organizations continuously 
make many similar choices* patterns of action may become highly routine. 
In these circumstances we may wish to exclude such choices from the 
Category of "policy," reserving the term for conscious choices which 
involve strategic or "critical" decisions (Selrnick* 1957). In other 
words, the conscious and goal-direeted nature of policy would appear 
to exclude those routine decisions that students of public administration 
typically group under headings of personnel, accounting, training, and 
research and developnieht. The essential feature of such decisions is not 
their functional character (e.g., personnel), but the degree to which 
they are routinized. Reasoned choices (rationality) may no longer be 
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necessary. "This situation typically cbrifrdhts organizations producing 
over and over goods or services of a reasonably well understood kind. 
Such organizations become highly rationalized , and we call them 
bureaucracies" (Thompson, 1976:64). 

A little reflection should make it clear that we are dealing with 
a paradox: the more "rationalized" an organization becomes, the less 
"rational" it is likely to be. Hence, actions which could originally be 
described as conscious and goal -directed may eventually be described as 
habitual, routine, and unconscious. Bureaucratic organizations may 
displace their original goals and become so highly "rationalized" that 
policymaking in the sense of consciously choosing courses of action to 
resolve problems is non-existent. Many public organizations designed 
to serve the public might well be described today as organizations which 
have lost much of their capacity to engage in rational choice. There- 
fore, "non-rational " is a more appropriate term for policy processes in 
many modern public bureaucracies. 

Distinctions between rationality, irrationality, and non-rationality 
suggest that the essence of policy is reasoned choice. When individuals 
choose particular courses of action they engage in several interrelated 
components ot reasoning: (1) the definition of a problem requiring 
action; (2) the analysis of alternative courses of action available, in- 
cluding predictions about their probable consequences; and (3) the choice 
of these alternative courses of action which will result in the most 
highly valued or preferred consequences. An individual who is making a 
rational choice typically reasons as follows: "the first available 
course of action leads to a particular result. The second available 
alternative leads to another result. The first result is more valuable 
than the second. Therefore the first course of action should be chosen." 

If we designate courses of action as A (Alternatives) and results 
as 0 (Outcomes), the problem of choice can be diagrainned as follows: 

Aj Oj 

Oj > O2 

choose Ai 

FliSURE 1-4 
A Simple Model of Choice 
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The above symBols state that A^ will result in 0^, and Ag will result In 
dg. Further, Oj is greater than (>) on some scale values. Therefore 
{.*.) choose Ay' 

This simple process of reasoning includes all the essential elements 
of rational choice. The first decision premise states that A^ will result 
in while the second states that Ag will result in Og. These are 
fa cta a l -prenri^es^ , which means that they can be shown to be true or false 
on the basis of factual knowledge gained by describing or predicting rela- 
tionships between alternatives and outcomes. The third decision premise, 
however, is based on human values. This value premjia states that 0^^ is 
preferable to on some scale of values--it cannot be proved right or 
wrong by factual descriptions or predictions. It is ah assertion about 
what is good or right for some individual, group, or humankind in general. 
All rational choices contain both factual and value premises. 

The above illustration is one of the simplest possible models (i.e., 
abstract representatives or pictures) of rational choice. Simple models 
have the advantage of clearly pointing out important elements of a problem; 
their weakness is that they may distort the complexity of problems. Con- 
sider, for example, the following assumptions of the simple model of 
choice described above (Zeckhauser and Sehaefer, 1968:28): 

1. The choice must be confined to one individual. If 
choices involve or affect more than one individual, 
thenit is likely that there will be different and 
possibly conflicting sets of factual and value 
premises. 

2. The_resuTts of a course of action must be known with 
certainty. In complex situations of choice, however, 
outcomes_are seldom known withcertainty because all 
individualsinyol yed in the choice do not possess 
full informatj^on necessary to establish factual 

and value premises. 

3. Results of a course of action must occur immediately. 
Given conflicting sets of factual^ and value premises^ 
together with insufficient information and uncertainty, 
results are often known only as they emerge during the 
course of action. 

Imagine how our simple model of choice involves the policy 
issue of whether or not to adopt a minimum wage policy for Unskilled 
workers. Note that the policy problem is defined here as one of wages-- 
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it itiight dust as well be defined as one of education or family environ- 
ment. Suppose we assume that there will be high compliance with any 
minimum wage legislation passed by Congress. We might already have 
excellent information on the existing state of affairs, Which might be 
one where minimum wage laws do not cover unskilled laborers. On the 
basis of this information We conclude that maintaining the status quo 
(no minimum wage laws) will result in an annual average income of $3,000 
among unskilled laborers. We might also predict that a minimum wage of 
$2.50 per hour Would result in an annual average income of $4,500 among 
unskilled workers who would be affected by the proposed policgr. Here our 
predictions based oh the assumption that employers will comply with the 
policy by raising wages to the minimum $2.50 per hour. Factual and 
value premises could again be simply outlined: 

Aj = 0^ ($3,000 annual income) 
^2 ~ ^2 (^^'500 annual income) 
0^ >0j 



ehoose Ag 



FIGURE 1-5 

1 of Choice ApBlied to 



the J^rot34em of Minimum Wages 



The above illustration fails to satisfy one or more of the three 
requirements of rational choice outlined above. Many different individuals 
and groups are involved in the choice of the second alternative, including 
employers, who may decide to reduce their complement of unskilled laborers 
in order to maintain existing labor costs under a minimum wage (alternatively 
employers may install machines with a higher long-term return or invest- 
ment, or hire students, who are not covered by the legislation). In 
effect, there is not sufficient information on the probable results of 
the policy, both because the plurality of policy actors is likely to alter 
the original factual and value premises, and because there is no direct 
past experience with the policy, without past experience there is no firm 
basis for predicting results; we cannot construct factual premises that 
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relate alternatives to outcomes in the absence of identical or highly 
similar actions taken in the past. Even if there were full knowledge 
of probable consequences > conditions may change in the future. In 
summaryi one or more of the assumptions required in bur simple model of 
choice is not justified. 

Suppose that a more thorough effort had been made to gather all 
relevant information on the policy issue of minimum wages. In addition 
to bur original alternatives of minimum wage legislation and the maintenance 
of the status quo we might have identified manpower training programs as 
a third course of actibn, reasbning that the pblicy prbblem is not low 
wages per se but an absence of skills necessary to qualify workers for 
higher paying jobs. We might have predicted in advance that three sets 
of results would follow each course of action. The first course of action 
(the status quo) would result in an annual average income of $3,000 among 
unskilled wbrkers who number 12,000. The second alternative (minimum 
wages) would result in an annual average income of $4,500, but depress the 
number of emplbyed wbrkers in the unskilled category to 9,000. The third 
alternative (manpower trairiirig) would result in an annual average income 
of $4,000, but increase the number bf employed workers in the unskilled 
and newly unskilled categories to a new level of 15,000. 

Each of the alternatives would have important consequences for the 
political fortunes bf Cohgressmeri. Maintaining the status qub wbuld 
result in a probable loss of 50 party seats in highly contested districts 
where labor and welfare rights organizations are powerful; minimum wage 
legislatibn would result in no electoral changes; manpower training policies 
would result in a net gain of 10 party seats in districts dominated by 
opposition party incumbents. Our simple model of choice now becomes 
considerably more complex (Figure 1-6). 
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- e^($3,0Od annual incotne) + Ogaz.QOO jobs) + 83(50 party seats lost) 
Ag » B^{$A,5m annual income) + 0g(9,000 jobs) + OgCno change in party seats) 
A3 = 07($4,000 annual income) + 0g{15,000 jobs) + Og(10 party seats won) 



O4 > O7 > 
Og > Og > O5 

Og > Og > O3 



choose A3 



FIGURE 1-6 
A Complgx^deJ gj^^ice 

Note that the third alternative is preferable to the other courses 
of action on all desired outcomes except one (Ag is preferable to.A , 
bat only on grounds of income). This situation of choice is describid 
as one in which one alternative is "dominant." In the left side of 
Table 1-2 below the third alternative dominates the first and the second, 
because it is preferred on all outcomes save one. In actual situations 
of choice, however, there are problems for which no one alternative is 
dominant. This situation is described on the right side of Table t-i. 
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TABLE i-2 
Rankings Of Outcomes 
By Alter natrves 



Outcome Ranking 1 Outcome Ranking XJ^ 



AUernatige Income Jobs Elections Income Jobs Elections 



^1 


3rd 


2nd 


3rd 


3rd 


1st 


2nd 




1st 


3rd 


2nd 


2nd 


3rd 


ist 


^3 


2nd 


1st 


1st 


1st 


2nd 


3rd 



A Situation of choice in which alternatives can be clearly ordered 
according to preferred outcomes is called an ordinal -utility ranking . 
The main characteristic of such rankings is that they are iran sitive : 
if alternative is preferable to alternative Ag in the [Daired compari- 
son [AjjAg], and alternative Ag is preferable to alternative A^ in the 
paired comparison [AgjA^] , then alternative Aj is preferable to alterna- 
tive in the paired comparison [A^.Ag]. An ordinal ranking can be 
easily constructed by assigning a number to each alternative, such that 
if A| is preferred to A^* Aj is assigned a higher number. The person 
making a choice maximizes utility (value) by selecting that alternative 
with the highest number. 



If all public policy issues could be analyzed in terms of 
ordinal-utility rankings, most policy problems could be easily solved. 
Regrettably, this is not the case: 

pi f f i cul t Choi ce probl ems In whi ch attri bute ranki ngs 
conflictlie at the core of the decisions that must 
be made by public poT icy makers. These_difficul ties 
may arise because their_decisions affect many individuals. 
Though policy A might be better for one group in _ 
our society, policy B might Be better for another^ 
If time-is a crucial element we may find for example 
that policy B will be better twenty years from today. 
In a third context, policy A might be superior if some 
uncertain events turn but favorably, but policy B 
might be a better Hedge against disaster (Zeckhauser 
and Shaefer, 1968:30). 
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STUDY QUESTIONS 



8. Define the following terrre: 
rational ity: 

irrationality: 

non-rationality: 

* rationalization: 



9. Provide examplesof public actions which^ given the nature of 
large public bureaucracies, may not be based on rational 
choice. 



10. A large number of routine decisions (e.g. in areas of 

accpunting^ personnel, training, research_and development) 
might be excTuded from any definition of poljcymakingi 
since these decisions are neither conscious nor goal -directed. 
Recalling that the various levels within policy structures 
arfinterdepehdeht, under what conditions would it be appro- 
priate, to include these decisions as part of any definition 
of policymaking? 
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11. Why might the term *'npn-r^ be appropriate for describing 

a large number of actions undertaken within modern public 
bureaucracies? 



12. What are the three basic components of reasoning present in any 
situation of rational choice? 



13. What are the key assumptions which underlie simf3le models of 
rational choice? 



14. Consider ah important policy issuesuch as the control of inflation, 
Provide examples of factual and value premises associated with at 
least two different approaches to defining the problem of inflation. 



15. What does it mean to say that the_main characteristic of an 
ordinal utility ranking is transitivity? 



^4 
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POLICY ANALYSIS AND RATIONALITY 

Despite the difficulties of applying simple models of choice to complex 
policy problems* it is still tempting to believe that a host of contemporary 
problems might be solved by collecting more and better informatioh. For 
example, cannot problems of crime, drug and alcohol addiction, social 
welfare, municipal services, and governmental finance be resolved by 
better calculations of the costs and benefits of different policies and 
programs? Is it not possible that more sophisticated methods for analyzing 
alternatives will produce at least marginal gains in the rationality of 
many public policies? Does not the impressive growth of computerized 
information systems promise the kinds of high quality information needed 
for better policymaking? In other words, cannot policymaking become 
more scientific? 

In principle, methods of policy analysis can improve policymaking 
in almost any contemporary issue area. As we have seen, however, policy 
systems with multiple actors and complex policy environments promote 
conflicting sets of value and factual premises, which is the rule, rather 
than the exception. Human values influence every element of policymaking, 
from the identification of policy problems to the implementation of 
policies themselves. In effect, there are multiple definitions of 
problems, and it is not unusual that different policy actors will select 
different sets of alternatives on the basis of identical information. 

Whatever else policy analysis may be, it is the application of one 
or more types of rationality to the resolution of policy issues. Policy 
analysis is a rational intellectual activity which employs multiple 
methods to monitor, evaluate, forecast, and recommend public policies. 
Policy formatidri * which includes but goes beyond policy analysis, is a 
rational intellectual activity embedded in a dynamic social * political , 
and organizational environment. The policy prbcesi may be viewed in terms 
of three component activities: 

!• Intel lectual--activ4ties of problem definition, 
forecasting, recommendation, monitoring, and 
evaluation; 
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2. Managerial activHi es of planning, staffing, drganiziiig, 
controlling and directing operations in the pursuit of 
organizational objectives; and 

3. Sociopo44t4€at aetiyities of negotiation^ persuasion, 
bargaining, and compromise, each of Which involves 
adaptations of policies in the course of time. 

Policy analysis includes several different ways for rationally gene- 
rating alternative solutions to policy problems. These tasks may be 
approached in at least four different ways, depending upon the relative 
emphasis given to methods , experience , and authiority as bases for 
choosing preferable alternatives. Public policy analysis includes 
intellectual activities of monitoring, forecasting, evaluating, 
and reconinending pdlicy alternatives, thus placing heavy reliance on 
methods as a basis for choosing preferable alternatives. For example, 
preferable alternatives are generated in a large part through the 
systematic comparison of alternatives in terms of their probable costs. 
Equally important, public policy analysis also includes experience as a 
source for developing the factual and value premises necessary to carry 
out systematic comparisons of alternatives. Ayth&rity . in the form of 
beliefs about the intrinsic goodness or badness of policies i also plays a 
minor but imjsOrtant role in public policy analysis. 

It is important to recognize that there are other modes for rationally 
generating alternative courses of action. For example, a variety of 
approaches which we might call "moralistic" or "ideological" place 
primary reliance oh authority as a basis for choosing preferable courses 
of action. Here it is the source of statements about public policies 
which is importahti rather than the methods by which alternatives are 
generated, or their basis in human experience. Commitmerits to policies 
because they are approved by some leading person, group or organization 
provide examples of authority as a basis for policies^ as does the 
practice of supporting alternatives because they appear to lie within a 
particular tradition (e.g., "liberal^" "conservative," "humanist," 
"socialist." "capitalist"). Although authority can be the primary basis 
for choosing preferable courses Of action, it is important to note that 
tnetJwds and experience are also employed as secondary or tertiary bases of 
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choice. Hence^ a particular policy may be chosen principally because it 
is consistent with the platfonn of a political party (authority); it may 
also be subjected to systematic analysis (methods) and adjusted in the 
course of implementation (experience), 

0ne of the major controversies dividing students of public policy 
in the past twenty years has centered on the relative Weight which 
methods and experience ought to play in the analysis and formation of 
public policy. On one side of this controversy ecdhdmist Charles Lindblom 
has written a series of influential books which argue that the experience 
of democratic societies in making and implemehtihg public policy ought 
to serve as the primary basis for assessing the rationality of any given 
policy. For Lindblom, who has outlined with David Braybrooke a theory of 
"disjointed irierementalism," policymaking: 

is decision-making through small or incremental 
OK) ves on particular problems rather than. through 
a cqmprehehsiye reform program. It is also endless; 
it takes the form of ah indefinite sequence of policy 
moves. Moreover^ it is exploratory in that the goals 
of pol icymakihg cohtihue to change as hew experience 
with policy throws new light on what is possible and 
desirable (Braybrooke and Lindblom, 1963:71, italics 
added). 

Incremental ism places primary reliance on experience acquired in 
the past, as well as that which evolves in an unfolding future; at the 
same time it places secondary emphasis on the authority of the policies 
and the methods by which they are generated. The theory of disjointed 
incremental ism employs the authority of democratic processes and methods 
for making continuous comparisons of alternatives as important supplementary 
bases for assessing whether policies are preferable ones. Thus, incre- 
mentalism has been explicity equated with democracy (authority), and sets 
of rules have been developed which together represent methods for 
generating incremental courses of action in democratic policy settings. 
Some observers even suggest that incremental ism is the only form of decision- 
making consistent with the group basis of politics in a pluralistic, demo- 
cratic society (Thompson, 1976:67) • 

The other side of the controversy is represented by an approach to policy- 
making that is often described as "comprehensive ratio;iality . " Comprehensive 
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rationality, sometimes erroneously equated with the discipline of economics 
and fields such as operations research and systems analysis, is often 
described as ah unrealist'JC methodological ideal. '*the ideal way to make 
policy is to choose among alternatives after careful and complete study 
of all possible courses of action and all their possible consequences and 
after an evaluation of those consequences in the light of one's values" 
(Braybrooke and Lindblom* 1963:40). In effect^ policy issues are treated 
as intellectual or technical problems, thus ignoring the orgariizatiohal 
and sociopolitical dynamics in which policies are formulated and carried out. 
Political scientist Thomas Dye (1975:27-31) notes that rational-comprehensive 
pdliGymakirig assumes that decision makers know al] society's value preferences 
and their relative weights, identify all policy alternatives available, 
correctly predict all the consequences of each alternative, and accurately 
calculate the ratio of achieved to sacrificed values for each alternative. 
Among the many objections to such assumptions the following are most 
important: 

1. There are no generally agreed uporisocietal value 
preferences, only those of particular individuals 
and groups. 

2. Values often conflict* making it difficult or im- 
possible to compare or weigh them. 

3. Policymakers maximize their own values--power , 
Wealth* status— and are not motivated to act solely 
Oh the basis of societal preferences. 

4. Policymakers do not maximize net values, but rather 
satisfy immediate demands for a solution. 

5. Large investments 1n existing policies and programs 

prevent policymakers from considering new alternatives, 
since previous decisions foreclose present options. 

6. The costs J availability, and time required to collect 
relevant factual data on all possible policy alternatives 
severely limit the search for information. 

7. Policjmiakers and social scjeritists_ cannot predict the 
fu11_range_of probable consequences associated with each 
policy alternative. 

8. Uhcertaihty about the probable consequences of policy 
alternatives induces policymakers to formulate policies 
Which differ little from the status quo so as to avoid 
uriariticipatid consequences. 
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Despite criticisms of comprehensive rationality as an approach 
which places primary reliance on methods . It is clear that itiany 
economists, operations researchers, and systens analysts also rely on 
experience and authority as secondary bases for assessing the prefir- 
ability of policies. Continuous siarch, feedback, and evaluation pro- 
cedures built into planning perfortuahce and budgeting systems (PPBS) 
reflect a concern with experience^ as does the recent emphasis bh 
systematic experimentation as a basis for analyzing social programs 
before they are adopted as general policy (Rivlin, 1971). Similarly, 
certain variities of policy analysis which go under the name of 
"publtc choice" are indistinguishable from incrimintalism in their 
rel iance Oh the authority of democracy in economic markets as a secondary 
basis for assessing the rationality of public policies (Qstrom, 1974). 

The point of view adopted here is that public policy analysis, 
properly understood* places equal reliance on methods, experience, and 
authority as bases for assessing the rationality of public policies. 
The comparable emphasis placed Ori methods, experience and authority places 
policy analysis within those traditions of dialectical inquiry variously 
described as "mixed scanning" (Etzibrii, 1968), "prescriptive-preferable" 
policymaking (Dror, 1971:261), and the "design of inquiring systems" 
{Churchman, 1971; Mitroff, 1974). Public policy analysis, viewed in this 
way, can be contrasted with prescriptive, descriptive, and authoritarian 
modes for assessing the rationality of policies. These four modes and 
their order of reliance on methods, experience, and authority are illus- 
trated below in Figure 1-7. 



Order Of 
Rel iance 



Dialectical 



Mod€ 0f Rati^al^h&i ce 
Prescriptive Descriptive 



Authoritarian 



Methods 




1 

2 



2 



2 



Ex 



ence 



1 



3 



Authority 



3 



3 



1 
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Four Modes Of Rational Choice 
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In coriciusion, it is important to note that the process of policy 
formation involves many coinpeting Conceptions of what is "rational"; 
for this reason policy formation may be described as mu1ti rational . 
Nevertheless, in considering this multirational character of policy 
formation we are not simply stating the obvious— namely, that individuals 
and groups tend to disagree about the sources of policy problems and their 
solutions. On the contrary, differences between the four modes of assessing 
the rationality of policy alternatives reflect fundamental ly different modes 
of rational inquiry into public problems. In this context political 
scientist Paul Oiesihg (1962) describes five types of rational ity* each 
of which is associated with a fundamentally different view of society: 

1. ^echEixal rationality is employed to solve technical 
problems, such that alternatives are assessed according 
to their utility in society. 

2. Iconomic rationality is employed to compare the costs 

and benefits of goods and services, such that alternatives 
are assessed according to their efficiency in society, 

3. beqal rationality is employed to assess the validity of 
written rules and recorded precedents, such that alterna- 
tives are assessed according to their legality in society. 

4. . Social rationality is employed to determine the consistency 

of societal norms and values, such that alternatives are 
assessed according to their contribution to the maintenance 
of social institutions. 

5. Substantive rationality is employed to resolvi Conflicts 
generated by applying technical , economics legale and 
social rationality, such that alternatives are assessed 
on multiple bases. Different kinds of reason are appro- 
priate for different types of problems.' 

These five types of ratibriality are closely associated with the fbdr 
modes of rational choice discussed above. ^Technical arid economic rationality, 
like the prescriptive mode of ratiorial choice, places primary reliarice ori the 
methods by which alternatives are generated arid arialyzed. Legal ratiorialUy, 
nice the authoritariari mode ^ emphasizes the personal, symbolic or ideological 
source of alternatives. Social rationality, closely associated with the 
descriptive mode of rational choice, places primary emphasis ori experience as 
a basis for maintairiirig the consistency of societal norms and values. Finally, 
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substantive rationality closely corresponds to the dialectical tnode of 
choice, which places conparable emphasis on methods, experience, and 
authority. Political scientist Yehezkel Dror's characterization of 
"prescriptive-preferable" policymaking is one of several approaches within 
the dialectical mode. Theory and experience "are all relied upon, the 
composition of the mix depending bh their availability arid the nature 
of the problem. Explicit arrangements are made to improve the quality 
of policymaking through systematic learning from experience, stimulation 
of Initiative and creativity, staff development, and encouragement 
of intellectual effort" (Dror, 1968; 1971:252). 



STUDY QUESTIONS 
16. What multiple methods does policy analysis employ? 



17. Gbmpare and contrast policy analysis with the process of policy 
formatiori. 



18. Define and provide illustrations of the four principal modes 
of rationally generatirig, arialyzing, and evaluating alternative 
solutions to policy problems. 
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19. 



What is the role of methods, experience, and authority in each 
of the four principal modes of rational choice? 



20. Compare and contrast "disjointed incremental ip'' and '^co^ 
prehensive rationality" as approaches to descrlMnx? policy^ 
making^ Npw compare and contrast them as approaches_to gre-- 
scrlMn^ policies. How does the role of methods, experience, 
. and authority change when we move from questions of descrip- 
tion to prescription ? 



21. List the objections to comprehensive rationality as an approach 
to policymaking. 



22. What are the major differences between dialectical, descrip- 
tive, prescriptive, and authoritarian modes of rational choice? 
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23. List the five 
teristies. 



fundamental types of rationality and their charae- 



24. What are the naj or points of similarity between dialectical 
modes of rational choice and substantive rationality? 
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THE PROCESS OF POLICY FORMATION 

Four modes for assessing the rationality of alternative courses of 
action— the dialectical, descriptive, prescriptive^ arid authoritatiari 
modes--rely iri fundatnentally different ways on methods, experience, and 
authority as bases for analyzing public policies. Now we shall consider 
in more depth the kinds of methods available to the policy analyst, which 
we shall call policy-- apa1jd:3 c procedures . The use of these procedures 
permits the analyst to transform experience into pol 3 cy^inf cmnattorial 
components- . Experience and methods are therefore interdependent; they 
are linked in a dynamic process of continuous change and adaptation 
which can be visualized as pol icy-iriformational transformations . Policy- 
informational components are transformed one Into the other by the applica- 
tion of policy-arialytic procedures-* In Figure 1-8 below there are five 
pol icy- informational components, illustrated as rectangles, arid six policy- 
analytic procedures, which are drawn as ovals. Policy-informational trans- 
formations are depicted as coririectirig arrows (Figure 1-8), 

fQ44cy- problems are the most general arid difficult to define of all 
the policy- informational components, A policy problem arises in connec- 
tion with three sets of circumstances. Firsts a human value or need 
must be identified. Second, certain events (e,g., rising costs of moriicipal 
services) must be defined as a public policy problem--i ,e, ^ as events 
which somehow Interfere with the realizatio or the satisfaction 

of needs amorig some segment of a community. Third, individuals or groups 
beyond that part of a coninunity immediately concerned must perceive them- 
selves to be affected and join 1n organized political action. The 
problem then becomes a "public" one. For a problem to come into existence* 
however, human values and needs must first be compared with some set of 
events. An identical set of everits— e.g.* the deterioration of housing 
In central c1ties--may or may not be defined as a public problem, dependirig 
on whether the views of urban, suburban * or rural populations are considered. 



J Readers familiar with the logic of science will recognize spme_ basic 
sinillaritles (but also differences) between this schema- and others which 
are used to Illustrate scientific inquiry as a dynamic process (Wallace, 
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Rectangles = Pol icy-Informatldhal Components 

Ovals = Policy-Analytic Procedures 

Arrows = Policy-Informational transformations 

FIGURE 1-8 

€ 1 eirents_df _ The_Process Of 
Public Policy Eorroatooft 
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In short, ho policy prbBlefn is "value- free," sihce humah values ahd heeds 
provide the basic categories according to which policy problems are 
idehtlfied. 

For any given policy problem there are a large number of policy 
alternatives^ available to alleviate or resolve discrepancies between 
values or needst on the one hand^ and events on the other. For example* 
increasing the availability and quality of central city housing might be 
accomplished through public investments in private cohstruction activities* 
the establishment of puBlic housing authorities, the provision of rent 
subsidies to urban landlords, or the disbursement of public home improvement 
loans/ In order to identify a set of appropriate policy alternatives, 
however, policy-analytic procedures of forecasting must be employed to 
predict the prpbable consequences of alternative courses of action. 
Forecasting permits us to establish the factual premises necessary to 
make a rational choice. Nevertheless* factual premises alone are in- 
sufficient to transform policy alternatives into policy actions, since 
any choice requires that we have at least one value premise. Course of 
action A^^ may lead to outcome 0^, which is different from Qg* but the 
choice between these two outcomes cannot be made unless they can be com- 
paP2d on some scale of values which permits us to assert that 6^ is better 
than (or vice versa). This assertion, as we saw above, is a value 
premise. Factual premises and value premis€ss are both necessary to apply 
procedures of iecomroendatloh such that policy alternatives may be chosen 
and transformed into pol icy actions . 

The transformation of policy problems into policy alternatives and 
policy actions therefore involves two policy-analytic procedures: forecast ihg 
and rec ommenda 44w> Forecasting, which is a special technical term for 
various kinds of prediction* assumes that we are first able to mbhitbr 
events and related courses of action (e.g., the physical condition of urban 
dwellings and the behavior of landlords receiving subsidies). Monitoring 
Itself is simply a special term for the description of events. Forecasting 
presupposes (i.e., requires before it can be done at all) mbhitoring, since 
predictions can normally be made only oh the basis of knowledge of similar 
events which have occurred in the past. Similarly, recommendation 
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presupposes forecasting as well as evaluation, since rational choice 
requires both factual and valae premises. Finally ^ evaluation pre- 
supposes TOnitoring, since information about certain kinds of events 
provides the factual premises which are to be evaluated. 



ET]he first thing. that has to be done in the 
analysis of a public policy issue is to mbhitor 
relevant conditions. Once mohitdririg is performed 
you are in a position to either forecast or evaluate 
the policy. To prescribe [or recorrmend] you must 
first. monitor, forecast and evaluate (Goplin, 



1975:23-24). 

these policy-analytic procedures are based on simple arid conmorily 
used methods for making statements about the world. Descriptive state- 
ments refer to the existence of everits^ or their causes, while predictive 
statements refer to the likelihood that events or actions will occur in 
the future. By contrast, evaluative statements refer to the goodness or 
badness, rightness or wrongness, of particular events. Prescriptive 
statements, which presuppose each of the other types of statements, refer 
to preferred everits which have been predicted In the future. These four 
types of statements are classified below according to time and the nature 
of their premises (Figure 1-9). 



Types of P^^ 



Time 



Factual 



Value 



Past/Present 
Future 



Descriptive 
Predictive 



Evaluate 



Prescriptive 



FIGURE 1-9 



Statements About Public Policy 
Classified According To Time 
And Type Of Premise 
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The application of procedures for forecasting and recomrrieridatidh 
is sometimes thought to be sufficient for attaining high levels of 
confidence that policies win result in preferred outcomes. Were this 
trlie^ however, a large number of administrative structures and procedures 
(e.g., citizens' advisory groups, auditors general ^ congressional conmittees) 
would simply be costly and unnecessary additions to government. The out- 
comes of policy actions would not require the application of procedures 
of monitoring arid evaluation , since all preferred consequences would be 
known in advance. Po3 4 cy ^e^fwmncB- -i.e., the degree to which public 
policies achieve their intended objectives— would be known at the moment 
a policy is recommended. But, as- we have seen, policy recommeridatioris 
are subject to varying degrees of uncertainty which derive from incomplete 
iriformation, the complexity of policy issues, and conflicts among multiple 
policy actors. 

Given these complications* policy-analytic procedures of mohitorihg 
and evaluation are employed to trsnsfdrm policy actions into inforrnation 
at)out poli cy out comes and policy performance . The outcomes arid performance 
of policy actidris canriot be known in advance with complete certairity; some- 
times they cannot be reliably predicted at all. Monitoring arid forecasting 
therefore perform a crucial role in providing information after policies 
have been adopted. Monitoring and evaluation are not simply requirements 
of forecasting and evaluation; they are also necessary for continuously 
generating new experience in the course of implementing policies. Pro- 
cedures of monitoring and evaluation provide us with information about 
policy performance which may lead to (1) the identification of a new policy 
problf ; (2) an adjustment of policies by recommeridirig riew courses of action; 
or (3) decisions to continue a policy unchanged, or terminate it altogether. 

Policy formatidri is therefore a dynamic process composed of inter- 
dependent policy-informational components and policy-analytic procedures. 
Nevertheless, if we recall criticisms of comprehensive rationality as an 
approach to policymaking we will recognize that processes of policy formation 
are not wholly regular * sequential ^ or invariant: (1) policies are sometimes 
formulated by individuals who perform highly specialized technical functions 
(agency policy .analysts), and at other times in situations where many 
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specialists and non-specialists interact; (2) policies are sometimes formu- 
lated quickly as .a response to crises, and sometimes slowly and over long 
periods of time; (3) policies are sometimes formulated with a high degree 
of methbdblogical rigor, through the application of formal statistical 
techniques and mathematical models^ arid sometimes in ari esseritially 
intuitive arid "extra- rational" mariner; (4) policies sometimes rely heavily 
on experiences generated in the course of implemeritatiorii while at other 
times policies are based primarily on kriowledge or assumptioris about what 
occurred in the past and therefore "must" occur in the future; and (5) 
some policies are carefully monitored and evaluated, while others are 
approached with no systematic procedures at all. Whatever the exact 
pattern of deviatibri from the scheme presented above, the relations be- 
tween components and procedures provide us with a systematic framework 
for comparing arid cdritrastirig differerit approaches tb pblicy formation 
in complex policy eriviroriinerits. The framework also enables us to assess 
the merits both of scientific arid popular theories bf pblicy formation, 
which may or may not tell us very much about the ways that policies are 
actually made. 

Returning to our discussion of four modes of rational choice^ it 
should now be clear that the process of pblicy formation cannot be 
adequately represented as one which is or ought to be universally reliant 
dri either methods or experience, as the controversy betweeri "incremental ism*' 
arid "comprehensive rationality" suggests. The dynamic iriterdeperidence 
between the five pdl icy-iriformational ebmporients (experience) and six 
pblicy-arialytic procedures (methods) suggests that policy formation may 
best be described as a dialectical process invblving relationships between 
thebry and practice, bri the one hand, and inductive and deductive approaches 
to inquiry on the other. These relationships are illustrated below as 
two basic dimensions of pblicy prbcesses (Figure 1-10). 
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Implementing 
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(Practice) 
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FIGURE 1-10 
Two Dimehsions Of Policy Processes 
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The two dimensions of policj? formation iliustfated above (Figtirisf 1-10) 
help to provide answers to several key questions aboat the role of policy 
analysis in public administration. Policy-analytic procedures of fore- 
casting and recommendatibn , for example, are always applied on the basis 
of the eenerete experience of particular individuals and groups. Efforts 
to apply techniques of trend analysis, computer simulation, and strategic 
forecasting— no matter how complex, sophisticated, Of formally rigorous 
these may be--afe always rooted in the experience and values of particular 
segments of a community. Hence, the application of experience to policy 
actions (deduction) is heavily dependent on the methods by which that 
experience was generated (induction). If experience results in the identifi- 
cation of the wrong problem, then even the most rigorous of policy-analytic 
methods will nOt help. Indeed, they may make matters worse. 

Second, it is not sufficient to have well designed policies and 
programs, so long as these cannot be systematically monitored and evaluated. 
Economist Alice Rivlin's critique of social programs executed during the 
war on Poverty emphasizes that the most well-intentioned applications 
of experience to the solution of social problems cannot replace experience 
generated through systematic monitoring and evaluation procedures (Rivlin, 
1971). This is because there are a large number of political and adminis- 
trative factors— for example, the legitimation, communication, coordination, . 
staffing, and control of policies and programs— which cannot be anticipated 
even with the most complete information and sophisticated analytic procedures. 
Conditions may change markedly in the course of policy implementation, thus 
dramatically influencing policy outcomes. In short, policy-analytic pro- 
cedures for generating experience from policy actions are equally important 
as those designed to apply experience in the form of forecasts and recommenda- 
tions. 

Third, the formulation of policies is closely linked to their 
implementation. In an important Sense, different views on policy formulation 
are really "theories" until they have been implemented and put into 
"practice." Nevertheless, theory and practice are interdependent; it is 
impossible to have one without the other. Hence, the definition of a policy 
problem exerts, a decisive impact on policy actions, and vice versa, such 
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that popular conceptions of the supposed dichotomy between "theory" and 
"practice" are surely exaggerated. The interdependence of theory and 
practice— of policy formulation and implementation— is further illustrated 
(Figure 1-lQ) by the ambiguous or marginal position of policy-informational 
components labelled policy alternatives, policy outcomes, and policy 
performance. Iriformatidri about these components is as much a matter of 
how problems were originally defined as it is a matter of concrete 
practice. Similarly^ policy problems^ policy performance, and policy 
actions also occupy a marginal position, between inductive arid deductive 
methods of generating and applying experience. . Each of these policy- 
informational components is affected by the application of experience in 
the form of policy alternatives, as well as by the generation of new 
experience in the form of policy outcomes. In summary * the conceptualiza- 
tion of elements of the process of public policy formation (Figure 1-8) 
and their two dimensions (Figure l-IO) calls attention to the interdependen 
of methods and experience, iriducticri and deduction, theory and practice. 
Irt succeeding: units we shall consider these interdependencies in more 
depth, beginning first with ah examination of the ways that information 
about policy outcomes is transformed into policy problems. 



STUDY QUESTIONS 
25. Define the five pol icy-irifbnnatiorial cbmporierits. 
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26. Define the six policy-analytic procedures • 



27. How are policy-informational components transformed one into 
the other? 



28. List the methodological prerequisites of forecasting, evalua- 
tion, and recommendation. 



29. How are factual and value premises related to time? 



30. List five reasons why the process of pol icy formation is 
not regular, sequential , or invariant. 



Si- 



Describe the two major dimensions of policy processes and 
their relation to each other. 
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SELF-TESTING EXERCISE 

1. There are literally tens of thousands of major, tnihbr, and fuhctiohal 
policies applied every day within the various issue-areas of public 
policy in the United States. 

(a) True 

(b) False 

2. All groups may agree on the importance of a policy issue, but may 
differ markedly in their r«t;--*:.ive definitions of the problem. 

(a) True 

(b) False 

3. Standard operating pr . . r'jles a» examples of routine policies 
which have, no influence or. jitegic deCsi^ns assoeiatea with major 
public policies. 

(a) True 

(b) False 

4. As policies proceed from the minor and functional categories to the 
secondary and major levels, public organizations have less freedom 
to develop policies autonomously. 

(a) True 

(b) False 

5. Questions of public accountability are more likely to be raised with 
respect to policies at the upper levels of policy structures. 

(a) True 

(b) False 

6. Public policies assume different forms and consequences, depending 
on:' 

(a) the characteristics of policy environments 

(b) The involvement of policy actors 

(c) The ways in which policy problems are defined 

(d) The level of policies within policy structures 

(e) All of the above 

6e 
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7. In 1969 the four most strongly held valties of Americans seemed to be 
national ism^^ quantity, worlc^ and efficiency. In 1980 these same 
values are Tikely to be held: 

(a) very strongly 

(b) strongly 

(c) weakly 

(d) very weakly 

(e) not at all 

8. "While the difficulties and dangers of problems tend to increase at a 
geometric rate, thenumber of persons qualified to deal with these 
problems tend to increase at an arithmetic rate." This statement 
describes Dror's 



9. The major elements of a policy system are , - - - 

and 

10. The process of "rationalization" in modern public bureaucracies is a 
good example of: 

(a) rational ity 

(b) hon-ratiohality 
(cj irrationality 

( d ) mu 1 1 i r a ti ona 1 i ty 

11. The following illustration shows that: 



(a) 


^1 


will result in 


(b) 


A2 


will result in 


(e) 


^2 


is preferable to'O- 


(d) 


^1 


is preferable to A^ 


(e) 


a. 


bi arid c drily 


(f) 


a. 


b, and d only 


(g) 


a. 


b, c, and d 



Alternatives/Outcomes 


Deaths 


Aj - (+2) 


+3 (High) 


Ag = 02 ^^'^^ 


+2 (Medium) 


02 > 


+1 (Low) 
0 (None) 
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12. What cbncluslbri wdtild ybo most Hkely reach 1n the decision 
situation Illustrated below? 

(a) choose 

(b) choose Ag 

(c) no rational choice Is possible 



d Ag 






^1 






A2 


- ^3 




^1 


> 03 






< O4 





13. 



The deeistOB isituatibh illustrated below Is best described as one 
with the following properties: 

(a) ordinal utility ranking 

mUltiratidhal ity 

transitivity 

intransitivity 

a, b, and c only 
a, b, and d only 
a arid c orily 



(b) 
(c) 
(d) 
(e) 
(f) 

(g) 



Aj = Oj + O2 + O3 
Ag = + O5 + O5 

A3 = O7 + Og + Og 

dj > O3 > O7 

> > dg 
d3 > dg > dg 
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14. Every act of rational choice may be said to have the following elements: 



(a) the analysis of alternatives 

(b) the choice of alternatives 

(c) the definition of a problem 

(d) all of the above 

(e) a and b only 



(a) a single decision maker 

(b) certainty 

(c) full information 

(d) transitivity 

(e) all of trie above 

(f ) a, b, and c only 



16. Policy systems are typically composed of multiple actors and complex 
policy environments, such that conflicting sets of factual and value 
premises are the rule, rather than the exception, 

(a) True 

(b) False 

17. Policy analysis is a rational intellectual activity based on the 
application of the following methods: 

(a) monitoring 

(b) evaluation 

(c) forecasting 
fd) recdmmehdatidh 
(q) a, c, and d only 
(f) all of the above 

a. Policymakers are often able to identify all or most of society's, 
value preferences prior to recommending and implementing alternative 
solutions to problems. 

(a) True 

(b) False 

9. Scientific research has shown that policymakers tend to maximize 

net or overall societal values, rather than satisfy immediate demands 
for a solution. 

(a) ' True 

(b) False 



15. Simple models of rational choice assume: 
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20. Policymakers, with the assistance of social scientists* can often 
aceurately_predict the consequences of all or most available policy 
alternatives. 

(a) True 

(b) False 
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ASSIGNMENTS 



1. A report on American education by sociologist James S. Coleman and 
his colleagues has generated intense debate on educational policy since 
its publication in 1166. The^"Colefflan Report," published under the title 
Equality of^EduMttona J-OpportufrUy f Washington. D.C.: U.S. Gbvernmeht 
Printing Office, if §6), challenged many assumptions about the impact of 
educational policies on student learning and achievement in the United 
States. For example, the Coleman Report suggested that such factors as 
pUpils per teacher, investments in equipment and facilities* teachers' 
salaries^ and the quality of curricula has no significant influence on 
student learning and schievesnent. Instead, t was found that family 
bacfegrdunds Gf students and their peers were closely related to iptitude, 
attitudes toward education^ and scholastic achievement scores. Further, 
Cole?.iap and colleagues found that black schools were not physically inferior 
to whits schools, and that black teachers have about the same education, 
experitjncei and salaries as white teachers. 

_ _ Id studying the policy implications of the Coleman Report the U.S. 
Civil Rights Comniissidh found that black students attending predominantly 
black schools had lower levels of aspiration and achievement than black 
students attending predominantly white schools, who alw had the same- 
or very similar family backgrounds as black students in predominantly 
black schools. The average difference in achievement between these two 
groups of black students was more than two full grade levels, although 
the achievement levels of white students in classes almost half black 
in composition were not lower than white students in all-white schools. 
Lastly, special programs carried but in black schools were found to 
have no' significant long-term effect on achievement- levels. 

^ The U.S. Civil Rights Coimiissioh used many of the conclusions of the 
Coleman Report to support policy recommendations designed to achieve racial 
balance through school busing. Since the appearance of the Coleman Report 
and subsequent efforts to implement busing policies, however, a number 
pf policy actprs--including government agerieies, professional educators, " 
social scientists, black leaders, and white neighborhood grbups, to mention 
the mos't important actors --have disagreed continuously and sbme- 
times violently about the report and its implications fbr public educational 
policy. Listed below are a series of statements from this debate. 

Each bf the statements below are primarily descriptive, prescriptive, 
evaluative, or predictive. Place the appropriate term 0*-e., descriptive, 
prescriptive, evaluative, or predictive) beside each statement belowr 

"Since schools in large urban areas are primarily 

black, the hopes of blacks for higher educational 
achievement cannot be realized." 

"The Cbleman Report is a racist document based on 

thfe myth of white supremacy," 
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"Educational reform win not bring about economic 
equality, since research shows that there Is no 
association between school achievement and earnings, 
either for whites or for blacks." 

_ ^ J _^ ^_ _ 

"Black students_bused to predominantly wh^ schools 

dp not Improve their performance relative to white 
students." 

"School busing is a failure, since it doesn't fielp. 
black students, and perhaps even results 1n psycho logica'! 
harm." 



"In thelong run, school busing is the only available 

alternative with wh1ch_to correct racial imbalances In 
public schools, and_shoald therefore be adopted as the 
only solution consistent with democratic traditions." 

"True social equality can only be achieved througn a 

radical redistribution of Income." 

- "A national policy of compulsory busing ought to be 
adopted as soon as possible." 

"Radical educational reforms, including massiv^e invest- 
ments special programs for disadvantaged black 
students, should be adopted to alter fundamental in- 
equalities of opportunity in the country." 

"Community control of schools Is a more Important 
objective than any abstract liberal commitment to 
goals of social equality." 

2. Each of the following statements about pubMc policy involves factual 

preSilses, value premises or both. Deslgnate eich, statement below as Including 
factual premises (FP), value premises (VP), or both factual and value 
premises (FVP). 

"Increasingly, Affirmative Action progran^r: in federal 

and state jurisdictions are demonstrating that all 
human beings are created et^ual." 

"The establishment by pe General Accounting Office 

of p)^ocedures for performance auditing is resulting 
In the recognition that many municipal services are 
declining In quality." 

"The Law Enforcement Ass Is Administration (LEAA) 

was established to attack increasing crime rates as 
our most Important unresolved social problem." 

"The black family structure i weakened during the long 

era of slavery, has been maintained In Its essential 
fcm by welfare programs which Insure that black males 
will continue to play a minor and Ineffective role in 
the family." ^ro 
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^ "Alcoholics and other drug addicts who do not possess 
adequate motivation to control their habit should be 
excluded from treatment programs under the proposed 
legislation. 



"Wei fare_ recipients are unlikely- to seek or .retain 
©nplbyment if they receive a guaranteed annual income 
Ihg the subsistence level," 



"Increasing the quality of early childhood education 

is the program *s most important aim." 

^ "Management information systems appear' to threaten 

fundamental individual freedoms guaranteed by the 
Constitution." 

3. Each of thefbur modes of rational choice is closely related to one 
or more of the five types of rationality discussed in Unit 1. Draw lines 
which connect modes of inquiry to the type of rationality with which each 
mode is most closely associated. 



Dialectical 
Descriptive 
Prescriptive 
Authoritarian 



Technical 

Economic 

Legal 

Social 

Substantive 



4. Think carefully about a public policy with which you are familiar * either 
because it has been important to your agency or because you have had some 
other. relevant experience (e.g.* a term paper in one of ydUf classes) with 
the particular policy.. Describe the policy in terrris of its five policy- * 
informational components and the six policy-analytic procedures used to 
transform one component into another. Use the space provided below for 
your answer. 

(a) What was the policy problem? 



Cb) What fbrecastii^g procedures were used to predict the results of 
alternative courses of action? 
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(c) What were the policy alternatives ? 



(d) What procedures for making recommendations were used? 



(e) What policy actions were taken? 



(f) What procedures for monitoring results of action were used? 



(g) What were the policy outcomes? 



(h) What procedures for eval gating outcomes were used? 



(i) What was the level of policy perfdrtnance? 



(j) Was a declsitri made to c ontinue the policy unmodified? To 
terminate it altogether? To modify the policy by identifying 
alternatives? Describe this decision. 
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Hhat events were originally defined and c3ass3fled as problems? 
In terms of What values or needs? Did the definition and 
classtfleatloh of events change in the course of Implementing 
the policy? In what way? 
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ANSWER KEY FOR SELF-TESTING EXERGISE 



I. (a) 2. (a) 3. (b) 4. (a) 5. (a) 6. (c) 7. (d) 8. "Oror's Uw" 
9. policy actors, policy environments, and public policies 10. (b) 

II. (e) 12. (c) 13. (g) 14. (d) 15. (e) 16. (a) 17. (f) 18. (b) 
19. (b) 20. (b) 
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INTRODUeTION 

Policy problems are human values or needs, self-identified or 
Identified by others, which may be realized or satisfied through public 
action. This definition has the advantage of pointing out the impor- 
tant role of human values and needs in identifying policy problems; it 
has the disadvantage of oversimplifying the nature of policy problems, 
since elements of problem identification are complex and far from 
obvious. In this unit we shall therefore examine in greater depth 
(1) the nature of policy problems, including their key elements and 
essential characteristics! (2) the effects of popular and scientific 
myths on the ideritlfi cation of policy problems; (3) the role of cer- 
tainty, uncertainty, and risk in shaping policy problems with different 
structu.-es; and (4) the uses of value clarification in policy analysis. 
We shall begin to examine these quistidns by focusing bh problem i -l-^ti fi ca- 
tion, a policy-analytic procedure which makes it possible to tran . ^ 
information about policy outcomes into policy problems. 



So 
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LEARNING OBJECTIVES 



After ebmpletirig this unit you should be able to: 

1. Identify the essential elements and major characteristics of 
policy problems. 

2. Distinguish between various popular and scientific myths about 
policy problems. 

3. Compare and contrast probl ems- icc^ to different degrees 
of "structuredhess" and recognize the operation of errors of 
the third type (Error jjj) in policy analysis. 

4. Differentiate arobhg processes of problem-solving, problem- 
prospecting, and prdblem-uhsolving. 

5. Apply alternative strategies of inquiry to the same problem 
domain. 

6. Apply different approaches to identify policy problems. 

7. Employ methods of value clarification to make the 
subjectivistic, artificial and dynamic nature of policy 
problems explicit. 
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KEY TERMS AND 

Problem Identification # 
Popular Myth H 

Self-fulfilling # 
Prophecy _ 

Scientific Paradigm 

Well -structured ^ 
Problem _ 

Structured Problem 

111 -structured Problem 

Error of the Third 



CONCEPTS 

Problem-solving 

Problem-prospecting 

Problem-unsolvihg 

Fornjal -deductive Mode of 
Inquiry 

Inductive Mode of Inquiry 

Dialectical Mode of Inquiry 

Value Clarification 
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OVERVIEW 



1 Object Ives 


Tasfcs 


Resources 


Evaluation 


1. Identify the 

essential elements 
arid major charac- 
teristics of policy 
problems . 


Study Questions 

-la 

Test Questions 
1.2 


Unit 
Narrative 


Self 


2. Distinguish between 
various scientific 
and popular myths 
about pol icy- problems 
and explain their 
role in policy 

Glia t gr 3 * d • 


Study Questions 

3,4,5 
Test Questions 
2*3,4,5,6,7 


Unit 
Narrative 


Self 


3. Compare and contrast 
problems according 
to different degrees 
of "structuredness" 
and recognize the 
ODSration of errors 
of the third type 
(Error in policy 
analysis. 


Study Questions 

6,7,8 
Test Questions 
1.8, 9,10, 11__ 
Unit Assignment 
4 


Unit 
Narrative 


Self and 
Instructor 


4. Dif f erehtiate bet- 
ween logical pro- 
cesses of problem- 
solving, prbblem- 
prospectihg.and 
problem-unsolving. 


Study Questions 

9,10 
Test Questions 
12,13 


Unit 
Narrative 


Self 


5. Apply alternative 
strategies of inquiry 
to the same problem 
domain. 


Study Questions 

: 17,12 
Unit Assignment 
1 


Unit 


Self and 
instructor 


5* Apply different 

policy-analytic pro- 
cedures to identify 
policy problems. 


Unit assignment 
2 


Unit . 
Narrative 


Self and 
Instructor 
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Objectives 


tasks 


Resources 


Evaluation 


7. Employ methods of 
value clarification 
to make the sub- 
iectivisitic, arti- 
ficial, and dynamic 
nature of policy 
problems explicit. 


Unit Assignments 
3 & 4 


. Unit 
Narrative 


Self and 
instructor 
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THE NATURE OF POL ICY PROBLEMS 



Public policies are authoritative guides for carrying out governmental 
action in national, state, regional, and municipal jurisdictions. This 
definition implies that public policies have clearly identifiable goals § 
it al<;o links the idea of public policy to government action. While most 
public policies do in fact involve recognizable gdals^ there are many public 
problen^ which persist or arise from an ebsence of goals and actions of 
government. For this reason we shall expand our definition of pclicy such 
that it includes inaction: "Public policy is whatever governments choose 
to do .or not to do'* (Dye, 1975: 1). 

This expanded definition enables us to consider an essential aspect 
of relationships between policy outcomes and policy probl ems— pbl icy 
Qr^lem m^-diTisB -f r^m^ about ^tl^ ^g nsequ^nces of government 

action as well as government inaction . This eharaeteristic of poi fey 
problems server to emphasize the importance of infarmation available prior 
to the identification of policy problems; it also raises difficulties in 
making judgmehts about the degree to which policy problems are the result 
of government inaction, since groups with contrasting political beliefs 
(e.g. conservatives, liberals, and radicals) take different positions on 
the responsibilities of government in resolving policy problems. For 
example, conflict concerning the role of government in protecting the 
environment reflect different views of pclicy outcomes and their relation 
to government action and inaction. 

Policy problems are sometimes thought to be easily identifiable, pro- 
vided sufficient information is available on the consequences of policy 
outcomes^ a view which is often expressed by such statements as "It's 
easier to raise problems then to find solutions.** For several reasons this 
view is largely a product of conventional wisdom and popular fnyth. First, 
the identification of policy problems is just as difficult as finding 
solutions Second, the nature of courses of action believed to be possible 
depends directly on the ways in which a particular problem is initially 
identified. Third, a poorly identified policy problem will almost certainly 
result in the choice of the wrong policy alternatives. Lastly, the identification 
of problems depends only in part on the availability and quality of In- 
formatics about policy outcomes. 

■ .._ 
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In general there are three key elements which must be present before 
any policy probl^^ms can be identified: Cl) informcitioh about events as- 
sociated with gbvernment action or inaction; (2) expectati^^ that events 
can be altered in some significant way; and (,3) judgments that some course 
of action is preferable oh some scale of human values or needs. The presence 
of information, expectations, and judgments is closely associated with 
the policy analytic procedure we have called probleS identification. 
Problem identifi^atiM itself refers to the process of using information 
about policy outcomes such that expectations about possible future states 
may be linked explicity with judgments about the value of present events 
or conditions. 

If we recall , cit this pointy ti»e .-najor features of postindustrial policy 
environments, it should be clear t::: : t.^: 5 is no convenient way of 
objectively defining a broad range of prbb!ci..s within many of the most 
important policy environments. Policy issues surrounding educdtion, nivenue 
sharing, cr-ime prevention^ foreign aid^ drug addiction and alcoholism, 
industrial health and safety* and environmental protection clearly permit 
the identification of multiple policy problems. In the area of education 
one sourcf5 of information on policy outcomes in e'^siientary and secondary 
schools (Equality of Educational Opportunity, 1966) has produced multiple 
defiiiitidhs of problems in American schools. Gohflicting points of viov 
of the meaning and implications o1^ the Coleman Report are directly related 
to procedures used to identify problems. In short, there are highly 
variable sets of information available on the "problem" of educational 
opportunity in the United States. 

Our examination of the three key elements of any policy problem 
(information, expectations, judgment) should serve how as a basis for con- 
sidering some of essential characteristics of policy problems as they 
envolve in complex policy environments. Policy problems typically possess 
the following characteristics (Churchman, 1971; Ackoff* 1974a, 1974b; Rein, 
1976): 

1. Subjectivity. Events, actions, and conditions are 
selectively defined, described, and classified. 
Selectivity is not "unscientific;" it is rather 
unavoidable, given that reality is inexhaustible and 
cannot be fully recognized or known. Explanations 
are ais>u subjective. Insofar as assumptions that are 
incapable ofFxientific proof In any form (e.g., 



PUBLIC POtieV ANALYSIS 



'tyibwl edge i societies and the world as a whole} 
are regularly employed as a basis for explaining 
events, actions^ or conditions (Sutherland, 1974). 

2. Artificial ity . Policy problems are possible only 
insofar as human beings are capable of making 
judgments that certain courses of action are pre- 
ferable on some scale of values . : ::'1s. Social 
problems and the societies , in w.;. -;iy arise are 
products of human activity* whilii ^jcieties and social 
problems areobjective insofar as regular patterns 

of behavior or social institutions can be known and 
predicted, human beings are both the products and 
the creators of society and social problems. 

3. J)ynam4c^. Pol icy problems are constantly changing, 
both as a result of newly emerging patterns of conflict , 
bargaining, and consensus-formation among groups with 
different values and needs , but al so as a consequence 

of experience and its effects on 

identifying new problems and modifying expectations 

and evaluations of old ones. 



4. Inflai^eness. There are as many differ 'nt solutions 
to a given set of problems as there are u3finitions, 
descriptions, classifications, explanations, and 
evaluations of events, actions, and conditions^_ Pro- 
blems are seldom if ever '^solved**; they are ''resolved*' 
and sometimes "unsolved" (Ackcff, i974a). 

5. ' Interdependence . : Policy problems in one area impact 

upon and are influenced by problems in another area. 
The quality of information available to identify a 
problem, as well as bur expectations that conditions 
may be imjaroved in the future, aeprnds heavily on our 
recognition that policy problem nave Tiultiple ex- : 
planations and multiple consequ .e.g. ecological 

destruction derives f rdm industr t > . growth, trarisportatio 
. networks, marketing practices * consumer preferences, 
arid the distributibri of political power, while its 
consequences are felt iri areas of employment, health, 
welfare i safety, and party politics). 
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STUDY QUESTIONS 



Answer each of the questions that folloW: 

1. "Our problem is not to do what is right," stated byhddh 
Johnson during his years in the White House. "Gur prbBlem 
is to know what is right." (Quoted by Robert E. Wood^ ^ 
Undersecretary, Department of Housing and Urban Development, 
in A. Bauer and K. J. Gergen (eds J The Study of Ptx^ltcy 
Eormat4oft . New York: Free Press* 1968 TTf. eonsldering 
njajpr characteristics of policy "problems— i .e. , subjectivity, 
artificiality, dynamics, infiniteness, and interdependence— 
• tn what extent can we know in advance which policy is the 
"righl:" one? 



A commonly accepted viewpoint among many pol icy analysts in 
universities and the government is that policy formation can 
be made "objective," in the sense that the analysts own values 
can be eliminated frorr; the process of formulating policy 
problems^ Given the three essential elements of any policy 
problem consider the extent to which this claim about the 
value-free nature of problem formulation can be sustained. 
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POPULAR AND SCIENTIFIC MYTHS ABOUT POLiCY PReBLEMS 

Bur exami nation of key elements and essential characteristics of 
policy problems should make it obvious that a variety of points of view 
about policy problems are inaccurate or distorted. One convenient way 
to discuss such points of view is to consider the prevalence of popular 
myths aBdut jsoliey problems. A i- opular 4tiyth . is a partial truth, a 
distortion of events, such that "a selective perception of much available 
evidence. . permits men to make some general sense out of half-understood 
and incompletely observed events" (Lowry, 19: i: 20). A popu^=lr myth, 
however much it may distort the actual meaning of events, may nonetheless 
be useful insofar as it makes it possible to make some situation intelligible. 
Certain myths surrounding Affirmative Action-Equal Employment Opportunity 
policies of federal and state governments- for example, white male stereo- 
types of "unqualified" ti.i'norities aggressively seeking jobs that they do 
not deserve, as well as minority stereotypes of white personnel officers 
systematically "discriminating" against qualified blacks arid women- -a re 
distortions of reality. At the same time these popular myths serve as 
explanatioris of everits, poiriting to the fact that some minority applicants 
are unqualified and some personnel officers di-^ :r-.minate on racial arid 
sexual grourids. The dariger of such myths is that they are not recogriized 
as partial myths arid distortions, but as fully adequate explanations of 
given conditions. One corisequenee of myths is that people act iri aqcordarice 
with them, chiefly because there is always some eviderice that cari be offered 
in support of distorted preeoriceptioris . Iri this way popular myths coritribiite 
to the developmerit of self-ful^iTUng prophecies : "Orie's iriitial pre- 
coriceptioris terid to become reality wheri drily those aspects of reality that 
support the belief are recognized and when the reactions of individuals to 
one another are such that they sustain the preconception" (Lowry, 1974: 20). 

Popular myths about public policy are widespread. Consider, for 
example^ the following preconceptions about policy problems, together with 
osirig pcirits of view (cf Lowry, 1974): 

1 . National Security 

— The Uriited States is an inherently peace-lovirig 
coUritry surrounded by hostile or aggressive 
states. A massive military establishment arid a 
strategy of bargairiirig from strerigth is riecessary 
to mairitairi national security. 
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— The United Statashytraditio pacificism; 
It has nonetheless engaged In a number of foreign 
wars. In any case many countries perceive the 
Bnlted States as hostile or aggressive; thus^ 
large military expenditures and the use of force 
or its threat only increases the probability of 
armed conflict. 

2. Crime 



-- Grimes of all types^ particularly crimes of_ 
viblehee, are higher t^-^^y than at any point in 
the country's history, the majority of crimes are 
committed by lower-'Class citizens, 

~ Street crimes involving violence have been more_ 
widespread in prev1ous_hjstorical periods than they 
are today. Some of the most serious crimes, both 
violent and nbh-violent, invoTve public officials 
and upper-class citizens. 

3. Poverty 



~ Poverty is_an unavoidable condition of_any_mqdern 
sdciity. Certain groups are tiheraployable because 
of mental and physical disabilities, age, illness, 
and lack of motivation. 

-- The meshing of poverty depends on ebcnnbhly accepted 
definitidhs which are continuously changing. Many 
unemployed, persons have high_mbtivatidh,^ extensive 
education, and excellent qualifications; others are 
unable because of their childhood surroundings and 
lack of opportunity to acquire sui'ficient: education 
to qualify for jobs; still others cannot be expected 
to maintainhigh levels of motivation in sickening jobs 
which pay only subsistence wages. 

4.' Drug-Addictio^^d-Al4:ohol ism 

~ Drug addicts and alcoholics are morally degenerate. and 
psychplpgically abnormal persons who come principally 
from the lowest social and economic class. 

— Drug addicts and alcoholics are physically and 
psychologically dependent on substances that result 
in tePiporary lapses into behavior viewed as unusual 
ordeviant. Drug and alcohol abuse occurs in all 
social classes; the prevalence of drug addiction 
and alcoholism is greatest in the middle class. 
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5. Racial and Sexual Iriequal itie s^ 

the disprdpdrtibh of white males in positions of 
prestige and power 1ri government and industry is a 
result of raciai and sexual prejudices pfkey people 
Who make decisions about hiring and promotion. 

— Racial and sexual prejudice is least evident among 

key people in government and industry. Racial and 

sexual imbalances in public and private organizations 
are primarily a - result of ^factors beyor.j_the_cont^^ 
of persons who make_hi ring and firing_decisions 
(e.g. , family structure and socialization, social 
values, inequality of educational opportunity). 

6. £co4^gy 

-- Pollution is caused by wealthy capitalists who wish 
to maintain existing levels of profit^ Some damage 
to. the environment is a necessary price to pay for a 
growing economy. 

— Pollution is caused by managers who seek to maintain 
existing levels of corporate perfonnance so as to 
retain their jobs or be promoted. Pollution in 
socialist countries iS often severe^: A healthy 
economy can be_5^:tai Tied without ecological degradation, 
provided that tho:.a : -^punsible for pollution— in- 
cluding manufacturtr: and consumers alike—are pre- 
pared to accept changes in behavior and life-styles. 

We have defined problem identification as the process. of using information 
about policy outcomes such that expectations about possible future states of 
affairs may be linked explicitly with judpents about thi valui of present 
events or conditions; it is dear that there are at least three broad classes 
of popular myths that exercise a decisive impact on procedures of problem 
identification (cf. Lowry, 1974: 24-25). We shall call these three classes 
of myth naturalistic^ monistic , and intrinsic . 

Naturalistic myths hold that any given set of events or conditions ii 
somehow the inevit:^Sle result of "natural" social processes.. Poverty* crime, 
unemployment^ discrimination, wars, authoritarian managerrient , and oLher 
phenomena are viewed as essentially unalterable, usually becaus-> of be-^ef? 
about the unchangabil ity of human nature, society, and organizations. TSa 
artificial nature of social problems and social institutions no: recognized. 
It is impossible in principle to identify policy problems, siric'3 ther:-t i> 
no basis for expectations that events or conditi^s might be altered i - 
some significant way. 
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M6nist4c mytfrs purport to explain porblems in tenns of monistic (single) 
causes. Problems such as pollution, discrimination, and crime are explained 
by the intentions, attitudes, or characteristics of the social backgrounds 
of particular groups. Thus, for example, pollution is believed to be a 
consequence of selfish capitalists; discrimination in employment a result 
of prejudiced managers; and crime a function of lower-class behavior and 
attitudes. Any expectation about altering existing states of affairs will 
be heavily influenced by one-sided monistic interpretations of problems. 

Lastly* intrinsic myths are likewise closely related to myths of 
the naturalistic and monistic variety. Whereas naturalistic myths promote 
the view that problems are ihevitable--ahd hence cannot, by definition, 
be a problem— monistic and intrinsic niyths encourage the belief that there 
are narrowly defined explanatidhs of problems. While monistic myths imply 
that single individuals or groups are the cause oi^ some condition, intrinsic 
myths promote the belief that tha persons most directly affected by events 
or conditions are themselves the cause of the problem. This particular 
myth, which Lowry (1974: 25) has called "blaming the victim", iaiplies 
that problems such as drug abuse, alcoholism, unemployment and dropping out 
of school are the result of inadequacies or imperfections in those whose 
behavior has been identified as a problem. Here the explanations of problems— 
and hence sol utions--are cast In terms of assertions about. moral wecikiiess, 
inadequate motivation, or negative attitudes, rather than looking O'jtward 
toward environmental conditions, social institutions, and the actions of 
other individuals and groups. 

Given that the various types of popular myths discussed abc/e are partial 
truths and distortions, it seems that the accuracy of beliefs mghz be 
improved by adopting a more sci^ittific posture toward social problems. While 
this statement is true, it overlooks similar myths within the scientific 
corrmunity wJiich clso influence che choice of problems. One type of myth is 
a scientific Paradigm which defines what problems are lenitim^te for study, 
serves as a sourci of preferred inethdcifi snd provides theoretical assumptions 
which contain sta^ •i^s'^c'! • fc-^- ic-irring whether new finding-j are acceptable 
soVitions to 5C ^ .■ ; ./-clt^ Philosopher thomai Kuhn has provided 
ctri k-izoa-' if^c . F ^ r/^v^:, which he defines as ''the sources of 
ih*^ ^wr.j-^ods, problem f ie ! : *; ..u^dards of solutions accepted by a very 
matut^ sc*aiu ;vic c^cj:-; r--^ , .. :> v^^e^ tlrr^^' (Kuhn 1970: 103). The 
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predominant feature of a scientific paradigm is its essentially conservative 
and parochial character. 

A consideration of essential characteristics scientific paradigms 
rai???% important questions about the ways in whi^ • coiioervative scientific 
paradigms can impede new disccveries, including scientific revolutions such 
as those associated with Copernicus and Einstein. Answers offered by Kuhn 
and otfiers involve several observations: (1) new findings are often 
discovered accidentally; (2) these findings cannot be adequately explained 
by theories within the dominant paradigm, thus creating a scientific "anomaly"; 
and (3) the ''anomaly" is either set aside as unsolvable or minor revisions 
are nide in the original paradigm or a Wholly new paradigm is developed 
to replace the fonner one. In the latter case, which is termed "extraordinary" 
science, we see the beglririihg of a ,genuine scientific revolution. This 
marks a period in which competing paradigms abound, old assumptions are 
criticized and rejected, arid the philosophical bases of science are 
scrutinized and sometimes altered fundamentally. 

The idea of scientific revolutions challenges the conventional view 
of science as objective, logical * c?- . native* an nherently innovative. 
This challenge is important for poli. / aiitilysis be:oS:^se it-points to social, 
psychological, arid political factors guid:ng uhe growth of scientific know- 
ledge. In public administration and the policy sciences, for example, 
there are numerous competing paradigms and partial paradigms, each of 
which is related to different world-views and beliefs about the nature of 
human ^eings* societies and organizations (Dunn and Fdzouni, 1976). In- • 
fdnnatioh about policy problem, expectations about future states of affairs 
arid judgmerits about the present are decisively influenced by such paradigms. 
At the same time there is no known way to use empirical evidence to "prove" 
or "disprove" the paradigm itself. In this situation it is obviously necessary 
to pay great attention to the philosophical assumptions and human values 
which underlie paradigms, given that "facts" are of little or no help 
in resolving disputes (GUrither and Reshaur, 1971; Von Wright, 1971; Tribe, 1972). 

There are a great mari.v ways to analyze the relationships between 
scientific paradign^ and policy problems. In order te illustrate briefly 
some of the major differences between paradigms in contemporary social science, 
together with their implications for the identification of policy problems 
we can consider two major dimensions of theorii^ about societies. One dimension 
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iC: what v^e will call the g gidlng- research intere'^t, which can assume two 
broctd rorm'>; a progressive interest in facilitating social emancipation 
versus a Cchservative interest in applying sQcial-tech^oa^j^ . A second 
dimension, which we will call the focus of explanation , also has two 
broad forms: an emphasis on ^rder versus an emphasis on conflict. 
Combinations of the two dimensions (Figure 2-1) help to compare and contrast 
different approaches to the identification of policy problems. 

These four broad types of paradigms can exercise a decisive impact upon 
the identification of policy problems.- thus, the passive radical may believe 
that radical changes in events or conditions are possible in the future. 
Slowly evolving changes in social values will result in the degree of 
consensus necessary to alter society fundamentally, yet in an orderly 
and stable manner which maintains the continuity of social institutions. By 
contrast, the active radical may expect fundamental changes, but believe that 
such changes will occur primarily through social coo Ti Jet and the redistributi 
of political and economic power, which will necessarily mean instability and 
discontinuity in social ihsti tuti ons . 

Conservatives with different foci of explanation mr;y . xpi^ct In J. only 
gradual changes in events or cdriditibhs are possible. Nevcr-^theless, passive 
conservatives, whose focus of explanation is on sources of order, view social 
change as ? kind of "natural" process which involves minimal conflict and 
more or less self-regulating adaptations to new problems. By c.;:^trast, active 
conservatives for whom the focus of explanation is conflict may advocate 
purposeful efforts to control society, such that social conflict and dis- • 
continuity may be resolved through governmental intervention in some form. 
Social technologists differ, U.eh, hot in their expectations of change, 
which are in both cases conservative or reformist in character; they differ 
rather in their beliefs about the degree to which gradual changes will come 
about "naturally," through inherent mechanisms of adjustment (order) ^ or 
through purposeful efforts to control changes that involve incompatible 
values and interests (coni^lict). 

Guiding research interests and foci of explanation are related to two 
of the major elements of policy problems discussed above: expectations 
arid judgments; To a large extent judgments about the desirability of some 
.course of action are directly linked to guiding research interests ^ which 
are either progressive or conservative. Similarly, expectations that 
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tied to explanations that focus on order or conflict. Different kinds of 



judgments and expectations affect perceptions of events or conditions in 
policy environmehts. in other words, the interpretation of ihfeniiatiori 
aboat policy outcomes is depehdeht on expectations and judgments formed 
on the basis of popular and scientific myths. This is one among several 
reasons that policy problems are subjectivistie, artificial, dynamic, 
infinite^ and interdependent i 



3. Provide two or three examples of scientific and popular 
myths about policy problems. 



4. In what ways do scientific paradi^gms influence the ways in 
which events in a policy environment are defined? 



5. A great deal of social theory attempts toexplain events and 
actions that have occurred in the past . At the same time 
policy-making in modern society is largely preoccupied with 
adapting to rapid changes in present conditions so as to de^ 
yisesolutions to future problems . Which particular temporal 
dimensions (past, present* future) are associated with the 
scientific paradigms discussed in the text? 
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THE STRUCTURE OF POLICY PROBLEMS 

Policy problems, as we have seen, cannot be identified in a wholly 
objective manner— i.e., policy problems . always depend in some way upoh_ 
expectations and judgments which derive from human values and needs. This 
is not to say that such problems cannot be examined systematically, or 
that policy problems are simply the arbitrary creations of different in- 
dividuals and groups, each of whose judgments, expectations, and sources 
of information are equally valid. The use of the term subjectivistic— rather 
than subjective- -is intended to emphasize that an important aspect (but 
not the whole) of policy problems does not depend solely oh "facts" or 
information" about policy outcomes. What we wish to do now is consider 
several ways in which the interplay of information, expectatidnSi and 
judgments may be studied systematically. We shall do this by examining 
the concepts of certainty, uncertainty, and risk as these contribute to 
policy problems with different structures. 

Recall our simple model of rational choice (Unit 1, Figure 1-4). 
Here we specified that any act of rational choice may be described in 
terms of a decision-maker who chooses among alternatives such that the 
alternative with the most desirable or valuable outcome will be selected. 
We further noted that certain cdhditions must be present before such a 
model can be accepted as viable, including a swingle decisidn-maker , 
alternatives which can be ordered transitively, full ihfdrmatidni and 
certainty. Let us now elaborate and extend our simple model of choice 
so that we can explicitly identify prdblems with different kinds of 
structures . 

A policy problem can be defined as follows (Mitrdff and Sagasti * 
1973: 120-121): Hdw td chddse from among a set of alternatives (A^, Ag, 
. . . etc.) that alternative (A^.)* which increases the decisdn-maker^s 
(Z*s) return (U^j)i where U^.j is the value or utility to Z of the outcome 
0^ ^ which corresponds to the probability (Pj) that a given alternative (A^. 
will result in expected dutcomes (0^^ = A^. , Pp . The problem, stated in a 



*The subscripts "i" and "ji' mean any one of several khdwn alternatives, 
utilities, outcomes, or probabilities or their cdmbinatidns . 
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simpler way, is for a decision-maker (Z) to choose one alternative (A) 
that will result in ah outcome (0) which has both the highest value (V) 
and the highest probability (P) of being attained. 

There are three basic types of structured policy problems, each of 
which is related in different ways to certainty, risR, and uncertainty: 



1. A policy problem under conditions of certainty is one 
where all alternatives (A.-},^ utilities"TyIpT"and but- 
ebmes (0.) are (cnbwh. In addition, relationships between 
alternatives (A^) and outcomes (0_.) are known to be 
invariant or deterministic, i .e. ,'^subject to hb error. 
Policy prbblems of this kind are well -structured . 



2\ A policy problem Urider cbhditlbhs of risk is one where 
all alternatives (A-). utilities (U. and dutcdmes (0.) 
are also known. In contrast with conditions of certainxy, 
relatiohships between alternatives (A.) and outcomes_(0 . ) 
are known prdbabnistically, i .e. * they are subject to 
known estimates df errdr. Such problems are also we44^- 
structured . 

3. A pdlicy prdblem under cdnditions of uncertainty is_one 
where all alternative (A.)j utilities (U-,-)» and out- 
comes (OO are also known. In contrastwith conditions _ 
of certainty and risk, relationships between alternatives 
(A^-) and dutcomes (0.) are known— but not_ in such a way 
that probabi 11 ties can be estimated for particular 
. cdmbinations df alternatives and outcomes. Policy problems 
df this kind are structured . 

Well-structured and simple structured problems permit the application of 
precise analytic methbds. In the case bf well -structured prbblems there 
are explicit rules for selecting one preferred course of action. Simply ; 
structured prbblems permit judgments about the directidh df expected 
outcomes'-- 1 .e. , the outcomes of alternatives are known to be either positive 
or negative* but without kridwledge of exact magnitudes or margins of error. 
Structured prbblens therefore permit "go" or "no-go" decisions. 

Policy problems which are il 1-structured ("wicked" or "messy") are 
those where one or more elements of choice— i.e., alternatives (A^. ), utilities 

(U..), br outcbmes (0.)~are either totally unknown, or known with little 

^3 _ __ J 1. _j i_ j__ 

or no confidence that relationships are not simply accidental. In this 

situatibn cbnvehtibnal analytic methods and rules df chdice canhdt be used. 

Ill-structured" problems "are problems such that the biggest problem connected 

with them is 'to define the nature bf the problem'. . . many social prdblems 

seem to be df this kind or quality" (Mitroff and Sagasti, 1973: 121). 



PUBLIC POLICY AT^ALYSIS 



Popular and scientific myths about policy problems encourage beliefs 
that problems which are in fact ill-structured are amenable to precise 
analytic methods and/or unambiguous rules for choosing among alternatives. 
It is here that problem identification becomes particularly crucial, since 
popular and scientific myths may contribute to the illusion that problems 
are well -structured or structured when they are not. Such illusions may 
be designated as Errors of the Third Type (Error jjj), which refers to the 
probability of identifying the "wrong" problem where one should have 
Identified the "right'* problem (Mitroff and Featheringham, 1974, )* 

The recbghitidn that policy problems are often ill -structured has led 
a number of observers to stress the importance of making clear distinctions 
between different approaches to problems (Ackoff, 1974a, 19745). Problem- 
solving is the process of defining objectives^ alternatives, and outcomes 
such that the one best (optimal) solution is chosen. By contrast, problem- 
prospecting involves a continuous search for different sets of conflicting 
objectives^ alternatives, and outcomes, such that persons making a choice 
can develop their own estimates of the validity of each problem formulation, 
while* at the same time, critically reflecting on the basis of choice. 
Problem-jjrisoJvinq , on the other hand, involves the conversion of solutions 
into problems, such that problems that are supposed to be solved are redefined 
and -nade the subject of further improvement: "Unsolving problems contributes: 
at least as much to progress as solving them does,. -.the failures of society 
and its institutions derive more from their failure to face the right pro- 
blems than from their failure to solve the problems they face" (Ackoff, 
1974a: 239). 



Errors of the First Type (Error.) and Second Type (Error. r) refer^to 
two types of statistical errors which occur when one attempts to deterinine 
if a relationship between two events occurred by chance (i.e.^ a test of 
a so-caned "null hypothesis")^ -In one case there is a ''cohservati ve" 
assumption about measuring change; in the other there is a more "liberal" 
assumption. Both kinds of assumptions result in risks that one will either 
accept or reject a null hypothesis where one should not have done so. Any 
good statistics text will contain a discussion of these two types of error. 
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Philosopher arid systems analyst t. West efiurchman has provided a 
useful account of relationships among the kinds of problems discussed 
above (well-structured, structured, and ill-structured) and the methods 
employed to identify problems in the first place (Churchman, 1971). One 
of ChUrchmari's most important conclusion is that the methods used to 
inquire into a problem--which he calls "iriquiririg systems "--direetly 
affect the structure of that problem. Adapting Churchman*s conclusions 
to public policy analysis we may say that (1) the ideritificatidri of a 
policy problem represents an inquiry into the nature of that problem; 
(2) to inquire into a problem is to select particular kinds of informatiori 
and not others;* (3) our knowledge about a problem is a function of the 
mode of inquiry we use to obtain information; and (4) to identify a problem 
"is to present irifbrmatibri on its riature to-sbme decision-maker who is 
(or may be) required to take action on the problem" (Mitroff and Sagasti, 
1973: 119). In other words * the pblicy-irtformational component which we 
call "pblicy problen^" cannot be separated from the mode of inquiry used 
to identify problems themselves. 

Three different modes of inquiry may be employed to identify policy 
problems: the formal -deductive, the inductive, and the dialectical. The 
main characteristics of each are described below.** 



1. formal -Ceductive . The formal -deductive mode of inquiry: 

seeks to develop a mathematical or symbolic representation of 
problems. Basic concepts that refer to events br cbriditions 
in a policy environment are linked together intb a rietwbrk 
of systematically ordered theoretical propbsitibris from 
which deductions about past and future events may be.made 
(e^g. , if A causes B, and B causes C* then A causes C). 
' Formal -deductiyerrodes of _ inquiry are best illustrated 
by_the use of computers to make prograimied (algorithmic) 
decisions. This mode of inquiry is best suited for well- 
structured_problems to which fonnal analytic methods and 
unambiguous decision rules may be applied so as to generate 
the one best solution. 



"[To] raise the question of the definition of fundamental terms is 
ise a pblicy-infbrmatiori question.,." (Mitroff and Sagasti, 1973: 131] 



irk - _ _ ^ L__\ __ 

For_a full treatment of these and other modes of inquiry see Churchman 
(1971) and Mitr^f and Sagasti (1^ possible to provide only 

the briefest summary of major characteristics of each mode. 
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2. Inductive, The Inductive mode of inquiry seeks to develop 
an empirical or inductive representation of prpblemSi : 
Empirical bbservatlbhs of events or cbriditibrisiri a policy 
envirbnment are cbnt1nuqusly_generated such that ah^ever 
increasing 5bdybf Information is made available. The 
inductive mode does not depend bn logical coh^tericy or 
the capacity tb make deductions abbut events, out rather _ 
bn the agreement aniohg_persbns presumed to be knowledgeable 
in a given area ("experts^'). Methods of systematteally 
acquiring expert bpihibhs and generalizing these for 
purpbses bf making pol icy recbninendatibfis prbvide_an 
illustration bf the inductive mbde bf Inquiry. This 

mode is best suited for well -structured problems on which 

there is already strong consensus. ^ ^ 

3. Dialectical . The dialectical mode of iriqUlry seeks to develop 
two or more completely antithetical symbolic or mathematical 
represeritatidns df_prbblems--i .e. ^ two dppdsirig represenations 
based dri the formal -deductive mode df inquiry. In addition^ 
both formal -deductive represehtatldris are applied td the 

same empirical dbservatidns dr data. Elements df the 
dialectical mode df inquiry may be fdund in ad hoc task 

forces composed df experts with conflicting opInlgnSi in 

councils composed of representatives from business, _government, 
consumer groups and trade unions, _arid In certain communities 
vvhere multiple constituencies con tnbute to 
of community plans. The dialectical mode of inquiry is best 
suited for ill -structured problems whose_ identification can 
neither be accomplished through consensus, northrough a j 
single formal-deductive representation of a problem^ The 
. process of problem identification is characterized by conflict 
and disagreement about the nature of the problem. The^objective 
of the dialectical mode is to aid policy-makers in forming their 
own estimates of the adequacy of different problem formulations. 
Conflicting assumptions are made explicit, such that some kind 
of "creative synthesis" is employed as a basis for decisions. 

Recalling at this point the four modes of rational choice discussed in 
Unit 1 (Figure 1-7), we can now make several explicit cdrinectidns between 
rational choice, on the one nand, and modes of inquiry bh the other. The 
dialectical mode bf rational choice places equal emphasis on methods and 
experience as a basis for decisions. Similarly, the dialectical mode 
of inquiry alsd places cdmparable emphasis on methods and experience, but 
in such a way that cbhflictihg fbrmulatibns of a prbblem may be applied to 
the same empirical data and compared. It is also evident that different 
modes bf inquiry and rational choice are suited to some types df problems^ 
but ridt dthers. 

the probability of identifying the "wrong" prbblem where one shbuld have 
identified the "right" one is increased where there is a mismatch or lack of 
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fit between modes of inquiry and choice, on the one harid^ and the structure 
of problems on the other. The use of the dialectical mode to identify and 
resolve problems in areas of accdUhtingi inventory, and cost controls 
(i.e.^ well -structured problems) results in Errors of the Third Type 
(Error jjj), as does the application of formal -deductive and Inductive 
modes to problems which cannot be successfully defined because of conflicting 
problem formulatiohs--e.g. , in issue-areas of public housing^ welfare^^ drug 
and alcohol tfeatment ^^ahd labor relations; The relationship between modes 
of inquiry, types of problems, and the probability that one will identify 
the "wrong" problem is illustrated below in Figure 2-2. 



6. The structure of policy problems differs according to the 
degree of uncertainty or risk attached to decisions. List 
the essential differences between certainty, uncertainty ^ 
and risk and their relationship to the structure of policy 
problems. 



There are several broad typesof organizatipn structures in 
which policy-making occurs. One type is a "bureaucratic" 
structure i whose characteristics include hierarchical _chain 
of command ^ specializatioa of tasks, and_full information. 
The "bureaucratic" form of brganizatioh requires certainty 
about preferred outcomes of policy as well as certainty about 
beliefs that certain courses of action (alternatives) will 
r^esult in a comrron set of preferred outcomes (J. S. Thompsdh, 
Organizations in Action , New York: McGraw-Hill, 1967 : 134-135). 
If many of the most important contemporary policy problems are 
"ill-structured," "wicked^'V or "messy" ones, what does this say 
about theapproprlateness of different types of organization 
structures for dealing with such problems? 
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8. Provide two or three illustratidris of Error^^yi using your 
own experience as an mustration. 



9, Considering "cdmprehehsive rationality" and "disjointed 
incremental ism" as approaches to policy-making (see 
Unit 1)^ which of the three logical processes of dealing 
with policy problems (i.e. , problem-solving, problem- 
prospecting^ problem-urisolvirig) appears most closely 
associated with each approach? 



10. Which of the three logical processes of dealing withpdlicy 
problems is most closely associated with each of the levels 
within pol-fcy structures discussed in Unit 1 (Figure 1-1)?. 
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ll. How are slrnple and compl ex models of c^^ discussed in^ 
Unit_i (see Figures 1-4-4 and 1-6) reled to formal ^deductive 
and dialectical _TOdes of inquiry? Specifically, how is the 
concept of an ordinal utility ranking connected with the 
notion of ill -structured problems and the dialectical mode of 
inquiry? 



12. In Unit 1 (h'gure 1-7) different modes of rational choice 
were linked to a reliance on methods * experience, or 
authority. How do formal -deductive, inductive, and dialec- 
tical modes of inquiry rely on methods, experience, or 
authority? 
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VALUE GLARIFieATigN IN POLICY ANALYSIS 

The systematic and eritieal examination of values is an essential 
element of policy analysis, principally because policy problems are 
subjectivistic, artificial, and dynamic. Wfiile most policy analysts 
agree that values can be studied systematical ly^ many also share the 
pqiht of view that values are simply relative to their source. This 
view, known as value relativism , implies that such values as social equity^ 
Cdimiuhal solidarity, and self-actualization are wholly incapable of ©npirical 
"proof" and, for this reason, are best considered as emotive or non-rational 
expressions of individual desires. The most that policy analysts can do, 
according to this view, is to treat values as "data" for purposes of 
analysis. Since this view assumes that the analyst's own values can some- 
how be eliminated from the identification of problems, it fails to recognize 
the subjectivistic nature of policy problems. 

Value relativism is associated with another position shared widely 
among policy analysts— viz. , the view that procedures or methods of 
policy analysis can be used for good or ill, depending only oh the purposes 
for which they are used. This view, which is known as applied scientifid 
j^ strumentalism , is based on a search for detached analysis arid value- free 
concepts. "Values" and "facts," according to this view, can and ought to 
be separated in the course of identifying policy problems, the policy 
analyst should accept certain values and problem formulations as "given" 
and then apply "neutral" procedures of policy analysis to reach appropriate 
solutions. 

there are mariy philosophical arid practical problems associated with 
value relativism and' applied scientific instrumentalism. As we have already 
seerii the key elemerits arid essential characteristics of policy problems 
raise sarious doubts about the "objectivity* of policy analysis. Equally 
important, values are not simply the persdrial psychdlbgical or emotive 
preferences af individuals, i.e., arbitrary expressions of individual wills. 
While values are often expressed in this persgnarl context, there are two 
further types of contexts iri which value statements and judgments are made. 
These are what philosopher Abraham Kaplan (1964: 190-191) calls the 
staridard and ideal contexts of values. The standard context involves value 
stateme5ts_ about particular (standard) situations—e.g. , "school busing as 
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a itieahs to achieve racial balance I'n schools is a 5ad policy in the eyes of 
most white middle-class citizens." By contrast * the ideal context involves 
value judgments that are not related to any particular (standard), context, 
but to all possible contexts irrespective of time and place. Relationships 
between value contexts and the form in which values are communicated are 
illustrated below (Figure 2-3). 



Context 


Form of Coirtiiunication 


Personal 


Expressions 


Standard 


Statements 


Ideal 


Judgments 




FIGURE 2-3 


The Context And form -Of 




mi cation Qf Values 



Whatever their context and form of cotrimuni cation. Values can be 
explained as Well as justified. While there is always a b asis oh which 
values may be explained (e.g., "The lower classes favor social programs 
designed to create greater equity."), there are also grounds on which values 
may be justified (Kaplan, 1S54: 387-388). The grounds of values provides 
reasons as to Why they should be accepted (e.g., "Programs Which insure " 
greater. social equity are the best way to establish conditions which facilitate 
the development of the human personality"). 

As we have seen in our examination of popular and scientific nyths 
about policy problems^ facts and values are interdependent, in order that 
a piece of information be considered a "fact" it must first be filtered 
through some conceptual framework, including frameworks established by the 
scientific community (scientific paradigms) and by means Of ordinary language 
(popular myths). Induction does not involve the direct apprehension Of "raw 
data;" rather.it presupposes basic concepts and categories with which to 
organize experience. Moreover, any given empirical general ization— e.g. , 
that the fiscal capacity of large cities is declihing--requires interpretation 
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1h terms of some thebryi paradigm; or frame of reference which itself implies 
certain human values and not others (Gurither arid Reshaur, 1971). The primary 
furictidri of frames of reference, paradigms, and theories (including those 
which are based on everyday language) is to explairi arid iriterpret eirpirical 
general izatibhs about events and cbriditiohs in policy environments. Never- 
the! ess, empircal data does not "'prove'* or "validate" frames of refererice 
paradigms* or theories; data can at best ''falsify" them, even though this 
is difficult and unconinon in social sciences (Von Wright* 1971: 203), Iri 
other words, the same data cari be, and often is, consistent with conflicting 
represehtatibhs of a problem. 

The implications of the above analysis are critical for an understanding 
of the role of values iri policy analysis. No scientific or popular inquiry 
into a policy problem will be free from the influence of human values, for 
all modes of inquiry are ultimately derived from beliefs about the nature 
of human beings and societies. These positions "are themselves a pri oris tic 
in nature, predicated as thfy must be dri cdsmblbgical-teleblogical suppositions 
(i,e,, a assumotibhs about time, order, conflict, and the ends of human 
life) which are incapable of empirical cdrrbbdratidri iri any form "(Sutherland, 
1974: 4). The implication of this statement is that all approaches to 
the analysis of public policy should be treated as pdteritially "ideblogical", 
iri the serise that particular methbds bf analysis detract from a recognition 
of values and interests which are implicit^ ambiguous* or cdricealed. Iri 
ecoridmist GUririar MyrdaVs wbrds, written more than thirty years ago, the 
"attempt to eradicate biases by trying to keep out the valuations themselves 
is a hopeless and misdirected veriture-— there is no bther device fbr excluding 
biases in social sciences than to face the valuations and to introduce them 
as explicitly stated, specific, and sufficiently concretized value premises" 
il, 1944: 133). 
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The recbgnitibn that values play a decisive rble in pblicy analysis can 
promote a self- reflective and critical orientation toward the ideritificatidri 
df policy prdblems, A set of working guidelines for value clarification in 
policy analysis might include the following (Tribe, 1972: 107): 

1. Insofar_as policy analysis ignores or disregards value 
conf1:icts and procedures for their resolution, there 
should be an attempt to make, explicit the Influence of 
different values in shaping interdependencies between 
policy-analytic procedures arid policy-informational 
components, _ Values should be regarded as an integral 
element of the policy process. - 
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2. Insofar as policy analysis conceals moraV i^ 

a search for yatue-free concepts and value-rietitral 
assumptions, techniques and_procedures, there should 
be^purposeful efforts to recognize and clarify value 
expressions, yalue_state!nents^ and value judgments- 
Human values in evit a bly influence policy analysis 
as an intellectual activity. 

3. Insofar as poUcy analysis rigidly separates facts 
andvalues, treating the latter as "given" or 
"constant," there should be attempts to focus on 
the basis and ground of values as these provide 
explanations and rational :i'ustifica^4^fts^ over time. 

4. Lastly, insofar as policy analysis passively accepts 
as "given" the ideritificatidh of problems on the 
basis of particular popular* and scientific myths, 
there should be greater attention to alternative 

formulations of problans, different modes of 

inquiry, and jDrbblems whose structures vary markedly. 
Some cbmbihatibri of prdbl em-solving, problem- 
prospeeting^ and prdbl em-uhsdlving may help to 
avoid one of the fateful errors of policy 
analysis— identifying the "wrong" problem where 

one should have identified the "right" one. 
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seLf-testing exercise 



1. the most decisive aspect of policy formation is the choice of 
preferred courses of action to resolve a proBlem^ since this 
determines the overall degree of policy performance in resolving 
problems. 

(a) True 

(b) False 

2. Human values enter into the choice of problems^ but need not 
influence our knowledge of why certain problems arose in the 
first place. 

(a) True 

(b) . False 

3. Popular and scientific rnyths are useful and even necessary, even 
in their most extreme or distorted form. 

(a) True 

(b) False 

4. A "self-fulfilling prophecy" is a good example of the practical 
effects of . in guiding future actions. 

5. "Poverty will always be with us. It is the result of the inherent 
uoempldyability of some segments of the population due to laziness, 
illness, age* mental inferiority, and the like." This statement 
expresses the following popular myths: 

(aj social problems are natural or inevitable. 

(bj social problems are the result of the Beliefs , 
values, or character of particular segments of the 
community. 

(c) social problems are the result of inadequate or 

deficient environments in which persons experiencing 
problems live. 

(d) a and b 

(e) a, b, and c 
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6. "Social problems_result from the ways that dominant groups in 
society define and identify deviations from commonly accepted 
forms, rather than as a conseqaence^of inriate^characteristics 
of individuals or segments of a community This statement is 
an illustration of the following characteristics of policy 



problems: 




(a) 


interdependence 


(b) 


dynami cs 


(c) 


artificiality 


(d) 


subjectivity 


(e) 


infiniteness 



(f) all of the above 



7, A decision problem under risk is one where: 

(a) the relation between alternatives and outcorres_ 
is urikhoWh or does not differ significantly from 
what could occur by chance alone. 

(b) the relation between alternatives and outcomes 
is known with complete certainty. 

(c) the relation between alternatives and outcomes 
is khdwh within certain acceptable bounds of 
likelihood or probability. 

(d) the relation between alternatives and outcomes 
is known in general, but estimates of likelihood 
or probability cannot be calculated. 

8. If many of our most important contemporary problems are "ill- 
structured," "wicked,'* or "messy," ""t follows that training 
for top-level managers and policy-makers should emphasize: 

(a) the acquisition of statistical tools, 

(b) skills in using management information systems. 

(c) human relations and other communications skills. 

(d) broad conceptual and analytical skills. 
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Which of the following problems are "ill-structured" ones? 

(a) developing a national policy for the treatment 
of alcoholics. 

(b) creating secondary school policies which will 
reduce the number of dropouts. 

(c) developing a reporting syst^ 

the TOni ton ng of Equal Employment Opportunity- 
Affirmative Action programs. 

(d) developing a system of sanctions against violations 
of the occupational Health and Safety Act (1975). 

; (e) develop! hg_effective guidelines for industrial 

waste to be enforced by the Environmental Protection 
Agency. 

(f) : allocating foreign assistance such that recipient 

countries remain progressive but politically stable. 

(g) all of the above. 

In order to improve the quai 1 ty of life of poor people in central 
cities very large investments in high-rise apartments^ office 
buildings, and cbhvehtibh and sports facilities_are made as; 
part of a plan for improving the quality of life in central 
cities^ Subsequently the poorest of residents leave the area. 
This description best represents: 

(a) error of the third type. 

(bj blaming the victim. 

(c) industrial development. 

(d? social disorganization. 

(e) all of the above. 
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11. As one moves downward in organizational policy structures from 
major and minor policies to standard operating procedures and 
rules we tend to find that the nature of policy problems changes 
such that: 

(a) problem-solving becomes more relevant. 

(b) problem-prospecting becomes more relevant, 

(c) both problem-solving and problem-prospecting 
become more relevant* 

(d) problem-sol ving_and pro&lem-prbspecting are 
equally relevant at all levels, 

12. The following are among the major reasons why problem-solving is 
inadequate as an approach to many strategic prbblerre of resource 
allocation in society: 

(a) mathematical and statistical techniques required for 
problem-solving cannot be used for solving ill -structured 
problems. 

(b) policy problems are artificial* subjective^ and dynamic. 

(c) the identificatioh of policy problems depends upon, human 
values which conflict and change over time. 

(d) information is never complete. 

(e) a and b only. 

(f) a* bs and c only. 

(g) bj c, and d only. 
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ASSIGNMENTS 



. To define, classify, explain, and evaluate events or actions 
in a policy ehyirohment requires that we use certain concepts 
rather than others. For this reason it has been observed that: 
|a? the conceptualization of a problem represents an inquiry 
into the problem's essential -characteristics or nature; lb) 
the conduct of inquiry into a problem results in particular 
Kinds of information on the problem's nature; (c) what we know 
about a problem is determined by the mode of inquiry we use to 
obtain informati oh; and (d) to conceptualize a problem "is to 
present information on its nature to some decision-maker who is 
ior may be) required to take action on the problem" (Mitroff 
and Sapsti, 1973 : 119). 

After reviewing the strategies of inquiry into policy problems 
discussed in the unit narrative, place the appropriate symbols 
ifP * Fortnal -Deductive, I = Inductive, 6 = Dialetical) beside 
the following strategies of inquiry employed to conceptualize 
policy problems in the issue-area of labor relations. 



"The Governor today received a conriissidned expert's 
report on problems of labor productivity in state 
agencies. The report states that the main cause 
of decreasing productivity in government-is the high 
rate of growth of unionized jobs, together with re- 
sultant increases in work slbwdbwhs and strikes. The 
report reicoinuends that the Governor introduce a set 
of strong legislative guidelines which will limit 
union irembership to public employees performing non- 
essential jobs and severely curtail rights to strike." 

_ "The Study Group on Labor Relation's today submitted 
its final report to the Governor. The Study Group, 
composed of experts drawn from industry ^ federal 
agencies, and leading universities across the 
country^ offered a unamimous set of conclusions and 
reconmendations^^ First, the Study Group finds no 
evidence to support the contention that increased 
unionization among public employees is the sole or 
even primary cause of declining productivity among 
public employees. Indeed, the report of the Study 
Group notes that productiyity in private industry has 
declined slightly more than in public agencies over 
the past 20 years, but with no appreciable increase 
in unionization. At the same time, observes the 
report^ there are increasing indications that labor 
tumoyeri absenteeism, and low morale are increasingly 
prevalent in public and private employment alike. The 
rpport goes on to state that such problems appear to be 
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related^to-changes in the work et^ produced. by a 
significantly higher level of edacatlon among all ^ 
employees than was the case 20 years ago^ The chief 
r^conroendation of the Study Gr^ is that_1egislation 
be Introduced to establish a mass^ of 
human relations training in state agencies." 

"A spokesman for public employees met today witfv the 
Sbvernbr to express their reactions to several recent 
reports on productivity in state agencitas. Unionized 
members i said the spokesman, are equally or mbre_ 
productive than nori-unibhized state eiiplbyees. The 
main source of strikes (whiehthe spokesman observed 
are fully within the law) is low wagesahd inadequate 
fringe benefits^ which are far out of line with private 
industry. Attempts tbdbdge such issues by instituting 
training programs, declared the representative, are 
simply mariipulativedevices that will further aggravate 
labdr-managemerit relations arid lead tb strikes." 

"A spokesman for the Gdverridr's office indicated. today 
that seridus thdught is being given td a prdpdsal td 
establish employee's cduhcils in each state agency. 
Councils will be composed of representatives from 
management, labor, and citizens' groups. The main 
issues which councils will address fall into three 
areas: wages and fringe benefits; the quality of 
public services; and working conditions, including 
employee discipline , working hours, and_ occupational 
health and safety. The spokesman reported that the 
Governor is unwilling tolnitlate or approve any new 

legislation until such time as employees^ .councils 

offer their first reports on di views of labor 

productivity in state agencies." 



2. Policy. analysis involvesclose interrelationsh^ 

and yaiues. this does- not mean, however, that factual and value 
premises-cannot and-Should riot be distinguished; the point is to 
avoid rigidly dichotomizirig them into mutually exclusive categories 
The following assignment. is designed to develop skills in value 
clarification 5 which involves the making of distirictibris between 
various kinds of facts and values. 

Each gerieralizatibri listed in the table below may be iriterpreted 
factually and valuatively. Iri each of the specified columns 
place appropriate responses to the followirig four kinds of ques- 
tions: 

(a) Value Expressibri, Statemerit, br judgmerit j^ br >) . 
Desigriate each gerieralizatibri in terms bf whether 
it represents an event, actibri, br cbnditibri that 
. is_gbbd br bad frdm the standpoint _bf your dwri 
values (persbrial cbritext), thdse df a particular 
group (staridard cdritexth br thbse bf humarikirid 
in gerieral (ideal cbritext). ^ . 
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(b) Valoe^Sroahd , Detemine the ground or justification 
of value expressions , statements^ and judgments_- 



first eolurmi. For example, if you have designa.ted-^_ 
as negative (bad) the statement Vmal nutrition causes 
mental retardation," the ground on which you assign 
the negative value might be: "mental retardation 
prohibits the attainment of full human potential^" 
Provide grounds for values in the personal, standard, 
and ideal contexts. 

(c) Rank Value . Rank each of the generalizations in the 
table according to its irnportance_as a policy problem. 
In this column, do hot designate generalizations in 
terms of their inehernt value (i.e. ^either good or 
bad), but in terms of a scale ranging from LO (most 
important) to 5.0 (least important), 

(d) Probable Accural Each statement_is also a_rnore or 
less accurate facutal description or_explanation of 
events, actions, or conditions,_ Determine the prob- 
ability thateaeh statement is true, using a scale that 
ranges from D.O (totally false) to 1.0 (absolutely true). 

Note that the table on the following page includes a 
sample answer in the first row. 



3. Return to the answer in_ the first row third cdlumri of Assignment 3. Does 
that ranked value represent an ordinal utility ranking with properties of 
transitivity? Explain your answer briefly. 
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Empirical 
' Generalization 


Expressidh/Stateiiient 
Judgment (+) or (-) 




Rank 
Value 
(1.6-5.0) 


Probable 
ficcuracy 
(0.0-1.0) 


1. tJealtliy persons re- 
ceive preferential 
tre"atiiient from the 
law. 


Personal 


- 


i a.11 not wealthy 


3.5 




; .90 

- 


Standard 




it is good for the rich. 


Ideal 


- 


Equality is essential for democracy. 


2. Fifteen percent of 
the population re- 


Personal 










ceives sixt;? percent 
of the incoine. 


Standard 






Ideal 




• 


3. Legalization of 
abortion guarantees 
fredoni of choice; 


Personal 










Standard 






Ideal 






4. Municipal services 
are increasing in 
cost and declining 
in quality. 


Personal 










Standard 






Ideal 







i 
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Empirical 
Generalization 


Expression/State 
Judgment {+) or 


ineiit/ 

(■! 


Ground 


Rank 
Value 
(1.0-5.0) 


Probable 
Accuracy 
(0.0-1.0) 


5. Lower-class persons 
are responsible for 
increasing crime 
races. 


Personal 











— — 

Standard 






Ideal 






6. Poverty will always 
be with us. 




Personal 










Standard 






Ideal 






7. Homosexuals and 
other sexual de- 
viants tend to 
commit more crimes 
than other groups 
in society. 


Personal 












Standard 




-■ ■■- - ■ 


Ideal 






8. Pollution is the 
result of the 
decisions of 

w^slthv husinpc^^c 

ricuiwirj uuoiiicjOwji 


Personal 










jldnQaru 






Ideal 
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Generalization 


Expression/Statement/ 
Jiidpnt (+) or ("j 


Ground 


Rank 
Value 
(1.0-5.0) 


Probable 
ftccuracy 
(0.0-1.0) 


9. States witfi com- 
petitive two-party 


Personal 










systems allocate 
more resources to 
welfare and social 


Standard 










services than those 
. party. 


Ideal 











SOURCE: Adapted from Coplin (1975). 
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PObieV PROBLEMS 



4. Using the public jsiallcy whicR )fod_ana1yzed ih_Unit 1 (Assignment 4)» 
provide short answers to the foil owing questions: 

(a) What are the contexts of the values which underlie 
the policy problem? 

(b) What is the basis for these values? 

(c) What is thi ground for these values? 

(d) Do values exhibit properties of ah ordinal utility rahkirtg? 

(e) Would you characterize the problem as well -structured , simply 
structured, or ill-structured? Why? 
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ANSWER KEY FOR SELF^TEStlNG EXERCISE 



1. (b) 2. (b) 3. (a) 4. popular myths. 5. (d) 6. (f) 7. (c) 
8. (d) 9. (g) 10. (a) 11. (a) 12. (g) 
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INTRODtjenON 



Problem identificatiorii as we have seen, involves the use of infor- 
mation about policy outcomes such that expectations about possible fu- 
ture states may be linked explicitly with judgments about the value of 
prisent conditions. Essential characteristics of policy problems— i.e. , 
subjectivity, artificality, dynamics, infiniteness, and interdependence- 
are therefore products of the interplay of information, expectations, and 
judgments. 

In this unit we shall examine in greater depth the policy- informa- 
tional component called policy outcomes. Specifically, we Will consider 
(1) the role of monitoring in transforming information about policy 
actions into information about policy outcomes; (2) the various ways 
that policy outcomes and actions may be measured; (3) the 
different methods available for surtmarizing, displaying, arid interpreting 
information; (4) alternative approaches to monitoring outcomes, impacts, 
processes and iriputs; and (5) certain fallacies associated with the 
measurement of policy outcomes and actions. 
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LEARNING OBJECTIVES 



After completing this unit you should be able to: 

1. Distinguish monitoring from other policy-analytic 
procedures. 

2. Compare and contrast different levels of measurement- 

3. Construct constitutive and operational definitions of 
outcome and action variables. 

'4. Select appropriate indicators arid indices with which 
to monitor policy outcomes arid actions. 

5. Employ differerit tabular arid graphic techniques to dis- 
play arid interpret information about policy outcomes and 
actions. 

6. Compare arid contrast different approaches to monitoring 
policy outcomes and actions. 

7. Identify various fallacies associated with the measurement 
of policy butcbmes and actions. 




POLICY OUTCOMES 



KEY " 

• Monitoring 

• Policy Outcome 

• Policy Output 

• Policy Impact 

• Policy Action 

• • Policy Input 

• Policy Process 

• Measurement 

• Levels of Measurement 

• Variable 

• Constitutive Definition 



AND CONCEPTS 

• Operational Definition 

• Indicator 

• Index 

• Tabular Display 
W Graphic Display 
9 Social Accounting 
9 Social Auditing 

• Social Experimentation 

9 Social Research Cumulation 

• Monitoring Fallacies 



134 



PUBtiC PetlCY ANALYSIS 



OVERVIEW 



Objectives 


Tasks 


Resources 


Evaluation 


!• Distinguish monitor- 
ing from other policy- 
analytic procedures. 


Study Questions 
1-4 

Test Questions 
1-5 


Unit. 
Narrative 


Self 


2. Compare and contrast 
different types of 
levels of tneasure- 
meht. 


Study Questions 

Test Question 
6 


Unit 
Narrative 


Self 


3. Construct constitu- 
tive and operational 
definitions of out- 
come and action 
variables. 


Study Questions 
7-8 

Test Questions 
7-8 

Unit Assignment 1 


Unit 
Narrative 


Self 
and 
Instructor 


4. Select appropriate 
indicators and in- 
dices with which to 
monitor policy out- 
comes and actions. 


Study Questions 

9-10 
Test Questions 

9-11 

Unit Assignment 2 


Unit 
Narrative 


Self 
and 
Instructor 


5. Employ different 
tabular and graphic 
techniques to dis- 
play and interpret 
information about 
policy outcomes and 
actions. 


Study Question 
11 . 

Test Questions 
12-14 
Unit Assignment 3 


Unit 
Narrative 


Self 
and 
Instructor 


6. Compare and contrast 
different approaches 
to monitoring policy 
outcomes and actions. 


Study Questions 

12-14 
TestiQuestions 

15-17 


Unit 
Narrative 


Self 
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Uujcc ui ves 




7. Identify various 


Study Question 


Unit 


Self 


fallacies associated 


_ 15 


Narrative 




with the measurement 


Test Question 






of policy outcomes 


18 






and actions. 
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THE ROLE OF MONITORING IN POLICY ANALYSIS 



Mdhltoring plays a central pols- in generating experience which serves 
as a basis for problem identification, forecasting, recorrtnendatibni and 
evaluation. Procedures for monitoring the consequences of policy actions 
provide us with information about how a particular policy worked arid why. 
Monitoring helps to establish factual premises after a policy has been 
implemented, thus cbntributirig to the ideritificatidri of rtew policy problems 
and serving as a basis for forecasting and recoirinending alternative courses 
of actibri. Mbriitbririg also provides essential information on policy out- 
comes, which may be evaluated in terms of the degree to which policies 
actually contribute to the resolution of policy problems. The essential 
differences among the five policy-analytic procedures are surwnarized be- 
low: 

1. Problem identification involves the use of information 
about policy outcomes such that expectations about _ 

possible future states may be explicitly linked with 

judgments about the value of present conditions. Policy 
dutcdrnes in various forms (e.g. , informatiqn_about pq 
unemployment, health) provide a basis for detennining 
whether present values or needs are being met—i.e., 
identifying a policy, problem. Problem identificationis 
the most complex of all pol icy-analytic procedures and 
does not_ seem to have a clear "logic" of its qwn._ The 
difficulty of clearly defining problem identification_ 
stems from the fact that it inyqlvesoperati of descrip- 
tion, prediction, evaluation, and prescriptiqn— i .e. , 
gperatiqns which are essential to the other policy-analytic 
procedures. 

2. ftonltorlnq involves the description of events and condi- 
* tions w1thin_some specifiable time period. Monitoring 

helps toestablish factual premises about the consequences 
of past policy actidris--i.e. , descriptive statements about 
how certain policy outcomes occurred and why. 
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3. Foreeastihq involves the prediction of events that may 
result from policy action (or inaction) in the future. 
Forecasting helps to establish factual premises about 
the probable consequences of ^faturg policy actions--i.e. , 
predictive statements^bout the kinds of outcomes which 
will result from alternative courses of action. 

4. Evaluation involves the assessment of the degree that 
previously monitored events have become better or 
worse according to a given set of^objectives. Evalua- 
tion helps to establish yai^j e premi ses^ about the 
desirability or worth of outcomes of actions-- 
i.e. i judpents about the degree to wFTclir policy out- 
COTOS actually contribute to the satisfaction of human 
needs and values. 

5. Recorritiendatibh involves the choice among alternative 
courses of action whose consequences have been forecast 
into the future. Reconmehdatibn establishes factual 
and value premises about the probability that future 
courses of action preferred bri some scale of values will 
actually occur—i.e.* prescriptiohs about courses of action 
which are likely to improve events according to a given 
set of objectives. 

The relationship between monitdring and other policy-analytic 
procedures can be illustrated by considering how a national policy- 
maker in the Law Enforcement Assistance Administration (tEAA) might 
employ information provided by the Federal Bureau of Investigation to 
make decisions about federal crime prevention policies and • programs. 
ThP F.B.I, publlsnes annual statistics in the form of Uniforro^Xrime 
Raports . which is a uniform classification of the number of serious 
offenses known to federal i state, and local police authorities per 
100,908 population, it is generally acknowledged that these statistics 
greatly understate the actual vblumi of crime, erime may go unreported 
because citizens believe that police cannot enforce the law, because 
they fear reprisals, and because police authorities desire to maintain a 
favorable jsublic inage. The actual volume of crime is thus two to 
three times greater than that which is reported ^ depending on the 
category (a.g. * rape versus burglary). Acknowledging these limitations 
a policy-maker may use the 4ln4form^rjme Reports as a basis for mbhi- 
toring events, actions* or conditions in the policy environment. An 
example of information from these reports is provided on the following 
page in Table 3-1. 
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TABLE 3-i 

Reported Offenses Per 100,990 Persons 
in Selected Years, 1960-72 



Category 


1960 


Year 

1965 


1970 


1972 


Murder and Non- 










Negligent Manslaughter 


5 


5 


8 


9 


Forcible Rape 


9 


. 12 


18 


22 


Robbery 


52 


61 


172 


180 


Aggravated Assault 


82 


10? 


162 


187 


Burglary 


465 


605 


1,068 


1,126 


Larceny 


271 


393 


859 


883 


Auto Theft 


179 


251 


454 


423 



SOURCE: Federal Bureau of Investigation, Uniform Crime Reports » 
1966-1971. 



A federal policy-maker can use information about policy outcomes 
contained In the Un i f orm ^^r4ffle^RepQPts to monitor, evaluate, forecast, 
and make recomnendati 6ns. First, the Uniform Crime Reports can be used 
to monitor annual changes in the incidence of known crimes in various 
categories. The first four eaitegOries Of crime in Table 3-1 can be. 
combined to form the category "crimes against person." The last three 
categories can be combined to form a second broad category, "crimes 
against property." These two broad categories can then be compared in 
terms of changes in the incidence of known crimes over some period of 
time (e.g., 1960-72). Second, the Uniform Crime Reports can also be 
used to forecast probable changes in the incidence of known crimes, 
assuming that present conditibns~e.g. i law enforcement policies and • 
programs i cbUrt procedures and decisions, unemployment rates, etc.— re- 
main the same. Third, information on changes in the incidence of known 
crimes can be used to evaluate existing policies and programs. For 
example, if special programs are established to reduce the incidence of 
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forcible rape, information in the Unifomi Crime Reports may help to 
assess how well such programs are performing over time. Lastly^ by 
assessing the results of a given program and forecasting its probable 
results in the future it may be possible to make recommendations about 
the continuation, termination, or adaptation of that program. 

Thus, for example, by calculating the percentage increase in 
various crimes between 196Q and 1972 (see Table 3.1) we will find that 
the highest increases are in categories of robbery (246?), larceny 
(226%), and forcible rape (144%). This kind of information can assist 
in monitoring the consequences of policy actions (e.g., rape prevention 
programs), in evaluating policy outcomes (e.g., we might regard any in- 
crease in armed robbery as unacceptable policy performance), 
in forecasting alternative courses of action (e.g., the greatest 
increases are likely to be in categories of forcible rape, armed robbery, 
and larceny, the least in categories of murder, aggravated assault, and 
auto theft) i and in r^»cotimiending appropriate courses of action to resolve 
problems of crime (e.g., heavy expenditures in apprehending murderers 
may be transferred to other categories). 

Figure 3-1 on the following page presents the five policy analytic 
procedures, these procedures are closely related and dependent upon each 
other. From studying this figure it should become clear that in policy 
analysis some analytic procedures are prerequisites of others, the fore- 
most step in any public policy analysis is the identification of the 
problem. Once the problem has been identified it is essential to monitor 
the consequences of policy actions. Monitoring provides iriformatiori about 
policy outcomes; it is only when information about policy outcomes is 
available that one can evaluate these outcomes. Results of evaluation, 
also, permit the policymaker to forecast policy actions in the future. 
The recommendatibn of courses of action, which is the last procedure* 
requires procedures of problem identification, monitoring, evaluation 
and forecasting. 
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Prerequisite Policy- 
Analytic Procedure 


Policy-Analytic 
Procedure 


Problem Identification 


Monitoring (e.g; , 
i hcreases i i n crimes 
between 1969 arid 1972) 


Monitoring 


Forecasting (e.g., 
probable iricreases in 
crimes between 1972 arid 
1980) 


Monitoring 
Forecasting 

* 


Evaluation (e^^g- § 
assessments of acceptable 
levels of perfbrmarice— 
increase^ decrease, no 
ctiarige— in 1960-72 and 
1972-80) 


Problem Identification 
Monitoring 

Frtrpi*a< ti na 
Evaluati on 


Recomnendatiqn (e.g., 
choosing among altema- 

b 1 ^1 Gillie VII die 

basis of information 
about actual increases 
in 1960-72, probable in- 
creases in 1972-80, and 
evaluations of actual 
and probable performance) 



FIGURE 3-1 

Policy-Analytic Procedures and Prerequisites 
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STUD? QUESTIONS 



Answer each of the questions that follow: 



What Is the relationship Between monitoring, forecasting, 
evalyation, and prescription^ on the one hand, arid the kinds 
of statements (descriptive, predirective, prescriptive, 
evaluative) which are made about public policies' 



Why can monitoring be described as "inductive" and "practical?" 



How might different guiding research interests (progressive Vs 
conservative) and foci of explanation (order conflict) affect 
the ways that policies are monitoredt 



4. 



What essential differences might there be in attempts to monitor 
outcomes of policy actions taken to resolve ill^structur ed^ oro- 
D'ems. as distinguished from well -structured ones? — 
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MEASURlNa PQtlCY OUTCOMES AN0 ACTIONS 

The discussion of monitoring should have already alerted you to the 
importance of systematic procedures for obtaining information about the 
consequences of policy actions • To monitor public policies in a number 
of issue-areas--e.g. , crime, pollution, health and welfare, emplbymeht, 
inflation— requires information which is relevant* reliable, and valid. 
If we want to know about the consequences of programs designed to pro- 
vide greater educational opportunity we will require information on 
the number of children from poor families who are completing schools and 
riot information about total school enrollment. We will, also, want 
to know how much error there is in any information available on policy 
outcomes. For example. We know that information on crime is unreliable 
by a factor of about 2.5:l~i.e. , there are some two to three times more 
crimes actually committed than reported. Finally, we also want to know 
whether information on policy outcomes is actually measuring What We 
think it is--i.e*i whether it is valid information. If we are interested 
in violent crimes, for example, information on increases 1n crime in gener 
(Which includes large increases in white-collar crimes and auto theft) 
will not be a valid measure of the kinds of policy outcomes in which we 
are interested. 

there is a large volume of information available bri consequences 
of pol^'cy actions. This information is collected at various points in 
time at a huge cost to federal, state, and local governments, as well as 
private organizations. Some of this information is relatively general — 
e.g., information about changes in social and demographic characteristics 
of the population as a whole—and some is more specific, since it is con- 
cerned with characteristics of states, regions, local communities ^ and 
public arid private agencies. Consider, for example, the following sources 
of information on policy outcomes: 

Historical Statistics of the United States 

StatiitJ^l-A&stract of the Uriited States 

united Sta^es^ Census o f-Populaiion by States 

The County and City Bata Book 

The Mun4c4paT-y earbaok -1.1) 

o 

U.S. Census of Manufacturers 
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Fortune Magazirie^^B targest Corporiti^s 

the Ecoflomjc^ft^fflanac 

Labor Fact. Book 

WhO-'s Who In A mer ic a 

Who's Who in the East 

Whdlj-Whb^^io iTwnerce an d Industry 

Who's Who in Labor 

WbHd-Jiandb66k-6f Pol4i4cal and Social Indicators 
Congressional Quarterly 
Law Btgest 

Current Qpinidh (Public Spihion Polls) 

Interuniversity-^nsortiui^^ Research (Political 

Attitudes and Behavior) " ' 

Nat44Mal Technical I rifbrmati on Service 

Center for CbbrdiMtion-bf-Researeh^on^^oci^ Indicators 

In addition to the above sources, federal, state, and 
local governments produce reports on particular programs, in areas of 
education^ health, anployment, consumer prices, crime and other areas. 
Finally, there is a large stock of bddks^ monographs, articles, and re- 
ports produced by universities and research institutes around the country. 

Despite this large volume of information collected at" high 
costs to society, we still do not have adequate informatidn on policy 
outcomes. One df the major reasons for this inadequacy is that the bulk 
of available information is often general in nature, while the information 're- 
quirements of mdnitdrihg cdnsequences of policy actions are ^pecj^j^ . 
We often wish to know how particular groups are affected by particular 
policies or programs (e.g., hdw the urban poor are affected by manpower 
training), but existing sources of information may be inadequate, unreliable, 
or invalid. For this reason a variety df special approaches to mbhi- 
tdririg have been devised to improve information about policy 
outcomes . 

In order to obtain information about policy Outcomes one must 
monitor the cdnsequences of policy actions; and to employ the policy- 
analytic procedure of monitoring one must be able to measure at least 
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tm different kinds of outcomes: policy outputs and policy impacts; 
policy outputs refer to the amount of work effort, or activity riquired 
to provide goods or services to target groups. For instance, per capita 
Welfare expenditures, units of service provided to the aged* or the 
workload of municipal recreation agencies are examples of policy out- 
puts. By contrast, policy impacts refer to the degree to which ex- 
pected changes in a policy eriVirOrimerit are actually accomplished. For 
example, the number of persons leaving public assistance rolls, the 
number of elderly Who are integrated into the life of the coimnunity, 
and the physical appearance and safety of parks and other recreation 
areas are examples of policy impacts. The impact of a policy or program 
includes several kinds of consequences: (1) its consequences for a 
particular target group, condition, or situation; (2) its consequericis 
for groups, conditions, or situations Other than the target (unintended 
consequences^ both positive and negative); and (3) consequences for pre- 
sent as well as future target groups^ conditions, or situations. 

In order to obtain information about these two types of policy 
outcomes we must also monitor palJcy actions— i.e. , the behavior of 
persons engaged in organizing, staffing, coordinating, directing, con- 
trolling, and budgeting policy and program activities. Again, there are 
two major types of policy actions: policy inputs and policy processes. 
Policy inputs refer to the money, time, personnels supplies, and other 
resources used to accomplish given levels of work, effort, or activity. 
Policy process, by contrast, refer to the structural, behavioral, or 
attitudinal characteristics which explain why a policy or program attains . 
given levels of output or impact. For example, decentralization of agency 
services, conflict among agency personnel, arid low morale of program staff 
may explain why policies and programs which have the same inputs result 
in differerit outputs and impacts. The important point is not to confuse 
policy outcomes (impacts and outputs) and policy actions (inputs and pro- 
cesses). To do so "has been compared to the measurement of the number of 
times a bird flaps its Wirigs without any attempt to determine how far 
the bird has flown" (Sucftnari, 1967:61). 

One of the most important aspects of monitoring is measurement. 
Measurment refers to the assignment of numerals to events or conditions 
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according to particular rules^ In general ^ there are two kinds of 
numerals: those that have quantitative meaning—and may be added > 
subtracted, multiplied, and divided— and those that do not. Numerals 
that do not have quantitative meaning are codes or categories that have 
the form of natural dichotomies (male/fesnale) or pdlytbmies (Black/White/ 
Puerto Rican/Oriehtal). A dichotomy is a set of two mutually exclusive 
categories; a polytomy is a set of three or more such mutually exclusive 
categories, two examples of polytomies are the numerals used to identify 
football players and those used to identify persons registered in the 
Social Security Program. Numerals are used to identify players or reg- 
istrants, but hot to rank then in terms of any characteristic. It makes 
no sense to add these numerals to obtain a total sum, or to divide such 
a sum to obtain ah average. 

Numerals which have quantitative meaning are called fiumber^ These 
can be added, subtracted, multipl ied, and divided. For example, we may 
wish to use numbers to add the dollar incomes of individuals in a par- 
ticular community, subtract from this total the dollar amounts paid in 
taxes^ arid divide by the number of individuals in the cornnunity. This 
would give us a measure of average disposable personal income. If we 
multiply by 4 (i.e., the average family size) we obtain a rough measure 
of disposable family income. 

There are four liv^ts- of-mea^rBmeflt used to monitor the consequences 
of policy actions: nominal , ordinal ^ interval ^ arid ratio > Ratio-level 
data have a true zero point and equal intervals and may be used for all 
aritlmetic operations. Data on personal income are ratio-level data, 
since low income means no income and the distance from $50-100 is the 
same as the distance from $2,450 to $2,500. Interval rlevel data , by 
cbritrasti do not have a true zero point, although intervals between units 
are equal. Air pollution indices, for example, tell us that a distance 
from 20.0 to 40.0 is the same as 40.0 to 60.0, yet 60.0 is not three times 
as high as 20.0, because there is no true zero point (i.e., 0.0 is not 
the c uivalent of "no pollution," any more thari 0° Fahreriheit is "no 
tCTperature). One may add arid subtract interval -level data, but division 
and multiplication are possible only when exercising great cautidri. 
Ordinal -level data neither have a true zero point nor equal interval s-- 
•strictly speaking, none of the arithmetic operations are appropriate, 
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although it is possible to perfortn such operations when care 1s exercised 
iri interpreting .results. Examples of ordinal -level data include measures 
of occupational status, quality of life, job satisfaction, and data from 
a variety of educational and psychological tests. Strictly speaking, 
the only operations possible are comparisons of more than, less than, 
and equal to relationships. Nominal-level data do not permit even 
comparisons of relative rank (i.e., more than, less than, equal to 
relationships). For example^ county and district codes used iri many 
states— i.e., numerals assigned simply, to Identify the county or dis- 
trict--obv1ously do not permit addition^ subtraction, multiplication, or 
division. 

bevels of measuranent are important mainly because our success in 
obtaining infontiation depends on how well we are able to construct re- 
liable arid valid measures of outcomes and actions. Sne way to coristruct 
measures is to begin by indentifying the variables which we are interested 
iri studyirig. A variable is any characteristic of an event or condition 
which takes on different numerical values. For example, policy impact 
variables include educational opportunity^ public safety^ and air* clean- 
liness. The difficulty with much policy analysis, however, is that we 
do not have precise defirtitions of variables. Variables have constitutive 
and operational definitions. Consti tutive- def i h i t i oh s assigri meaning 
to the words we use to describe variables by using other words. Such 
definitions are sometimes called "dictionary" definitions because they 
use synonyms to define particular words. For example, "educational 
opportunity can be defined as "the freedom to choose learning situations 
appropriate to one's abilities." Obviously such defiriitioris, while 
necessary f are not sufficient to provide us with Information about policy 
outcomes, since they do riot provide a link with the "real world." An 
operatidrial definition ass.igns meaning to a variable by specifying the 
operations that are required to measure the characteristic. Operational 
definitions specify the kinds of activities that census enumerators, prooram 
personnel, or researchers use to measure particular characteristics. For 
example, "educational opportunity can be defined operationally as "the humbe 
of children from poor families who ehrdll in colleges and universities." 
This operational definition of educational opportunity is clearly superior 
to the constitutive definition ("the freedom to choose learning situations 
appropriate to one's abilities") provided above. 



POLICY OUTCOMES 



Operational definitions, while clearly superior to constitutive 
definitions in their capacity to provide information about policy but- 
ebmeSi do hot directly measure such variables as educational opportunity, 
public safety, or public health. Rather we use indicators of variables— 
i.e. i an observable characteristic such as school ehrollmeht, reported 
crimes, or the Incidence of various kinds of illness which are substituted 
for less observable (arid sometimes nbri -observable) characteristics of a 
policy environment. An Index is a combination of two or more indicators, 
a kind of summary of informatiori about an outcome variable of special in- 
terest. For example, an index of poverty can be constructed from several 
indicators: caloric iritake per capita, percerit of population below $3,000 
annual family income, and the share of total national income earned by 
the lowest fifth of the population. One of the great advantages of 
economic arid social iridicators is that they permit us to measure policy 
outcomes over time (longitudinal monitoring) as well as to compare policy 
and program activities Jri differerit locatioris (cross-sectiorial moriitoring). 

In monitoririg the consequences of policy actioris iri various issue- 
areas one can identify the policy problem and specify the kinds of in- 
dicators we Will use to measure output, impact, process, and input 
variables. An example has been provided below (Table 3-2), 
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, tfldjcatori Available to 
Monitor Outcome afld-Sn-i/arja^ks- • 



Policy 
Problem 


Outcome Variables . 
Outputs Impacts 


Action Variables .._ 
Processes inputs 


(deduction of 
Poverty 


Welfare 
Expenditures 
Per Recipient 


Standard of 
Living for • 
Welfare 
Recipients 


Educational 
bevels of 
Community 
Workers 


Program 
Expenditures 


Qualitv of 
Working Life 


Recreational 
Facil jties 
Per Employee 


Self -Esteem 
of Employees 


Ertiplpe 
Participation 
in Agency 
Decisions 


Expenditures 
on Recreation 
Equipiiient 


Crime . 
Prevention 


Criniinals . 
Apprehended 
Per 100,000 
Known Crimes 


criminals 
Convicted 
Per 100,000 
Actual 
Crimes 


Number of 

Illegal 

Arrests 


Expenditures 
for Police 


ilproved 
Riihicipal 
Haste 
Disposal 


Hours Worked 
By Sanitation 
Workers 


Cleanliness 
of City 
Streets' 


Morale 
Among 

Sanitation 
Workers 


Expenditures 
for Sanitation 
Workers 
and Equipment 
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The ultimate purpose of measuring outcomes is to relate any given 
change in policy outputs and impacts to policy actions. Hence, expendi- 
tures (inputs) ind the structure, behavior, and attitudes of program 
personnel achieve given objectives (outputs and impacts) better than 
others. While unit 6 will examine the policy-analytic procedure of 
evaluation in greater depth, it is important to note here that information 
about policy actions and outcomes allows us to measure: (1) the effort 
put into a program (inputs); (2) the effectiveness of a program in 
attaining objectives (outputs and impacts); and (3) the efficiency of 
a program in attaining objectives with given levels of effort (outputs 
or impact, divided by effort). 



5. List several advantages of being able to describe policy outcomes 
and impacts with continuous measures (i.e., ordinal, interval, 
and ratio data). 



6. Monitoring involves the generation of experience. In this regard, 
what is the importance o f ope rati onaJ^ef i n i ti ons^ in generating 
such experience? ■ 
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?• Much of the infonnatiqn on poHcy outcomes reported in the mass 
media Is based on constitutive definitions of actions, events, and 
conditions. What problems does this raise? 



8, tist two or three indices which are readily available for purposes 
• of mbhitorihg the butebmes of various public policies. Of what 
specific indicators are these indices composed? How are these 
individual indicators combined to form the index? 



9. In what ways do indicators of outcomes and actionsdiffer? How 
do these differences affect the way that policies are evaluated? 
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DISPLAYING AND INTERPRETING DATA 

Tfiere are various ways to analyze information about policy actions 
and policy outcomes. One of the simplest ways to display and interpret 
data is to compate their eefltral tendencies- -i.e. . measure the center of 
the distribution of a set of data. The mean is a convenient »ray to 
summarize the central tendency of a whole set of ratio or interval data. 
We may wishi for example^ to compute the average monthly social security 
benefits received by retired workers In selected years between 1940 and 
1975. We would simply add the total monthly benefits over selected years 
and di-vide by the total number of years (i.e., 7 years). This has been 
done In Table 3-3 below. 



TABLE 3-3 

Average Monthly social Security Benefits ib 
Retired WbrJcers in Selected Years. 19 40-1975 



1940 


1950 


1960 


1965 


1970 


1972 


1975 


Mean 


$23 • 


$44 


$74 


$84 


$100 


$117 


$183 


$89.29 



SOURCE: The Budget of the United States-^emnent, 1975 (Washington, 
D.e.: Government Printing Office* 1974). 



For any^set of ra^tio and interval data we can calculate the mean , medlaa , 
arid mode . The median for Table 3-3 is simply the middle number in the set 
of seven numbers arranged in ascending order (i.e., $84). the mode is the 
simplest measure of central tendency and may be found by locating the most 
frequent number of value in a data set. In table 3-3 there is no mode, 
since all values occur with equal frequ -^cy, i.e., once each in the seven 
year period. Table 3-3 is quite simple. Other sets of data are suf- 
ficiently complex that the computation of measures of central tendency 
is essential. Consider the following set of data on federal government 
expenditures a^s a percentage of total general expenditures in selected 
years since 1902 (Table 3-4). 
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TABLE 3-4 

; feflecal ExpenditttgesJts a Pereeritage 
of Total Governrtient Expendltures^in 
Selected^ Yeari^ 1902-1972 



1 car 










31 




40 




31 




34 




so 


1940 


48 


1944 


91 


1946 


82 


1948 


64 


1950 


64 


1952 


71 


1955 


66 


1960 


62 


1962 


63 


1967 


65 


1970 


66 


• 1972 


65 



SOURCE: T.R. Dye, Understanding Public Policy (Englewood Clifts: Prentice 
Hall, 1975), Table 9-4, 205. 
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The mean for data in table 3-4 is 57.1 percent* as eompared with a 
lian of 63.5 percent •* In the same table, however, there are four 
modes comprised bf two numbers each in with these values"66%* 65%* 64«* 
and 31%. All measures of central tendency (mean, median, mode) may be 
calculated for interval and ratio data. For ordinal data drily the mediari 
arid mode should be calculated, while nominal data permits the calculation 
of the mode only. The use of a particular measure of central teridericy 
can be importarit for the interpretation of data on policy actions and 
outcomes. Someone wishing to argue that the average share of federal 
governmerit expenditures since 1902 is a'pproximately equal to federal 
expenditures in the 1960-1972 period (64.2%) would benefit from the 
selectibri bf the median (63.5%) as the measure of central tendency, 
rather than the mean (57.1%). At the same time averages of any kind 
may be misleading. Which is one reasori that measures of variability are 
used. One measure of variability is the rafl^e—deflned as the difference 
between the highest arid lowest riumbers in a data set. The range for 
Table 3-4 is 60%— i.e., 91% (1944) minus 31% (1913). Obviously, the 
meari* mediari, arid modes of this data set cannot be adequately interpreted 
without some measure of variability such as the range, which in this case 
shows that there are large differences between years.** 

Much irifdrmatidri dri pdlicy dutcbmes arid actions— e.g. , numbers of 
persons in target groups, unonployment rates, air pollution indices, 
levels of goverrirnent expenditures— is displayed In the fdrm df such tables 
as those presented above. Another, way to display and interpret data is 
the graph , which is a pictorial representation of data. A graph can be 
used to, show changes iri brie or more variables over time, or for comparing 
two or more related variables at one point in time. A graph displays a 
series of pbirits, each of which marks the coordinates of two differerit 
numerical scales. The horizontal scale is called the abscissa (or x-axis) , 



*Npte that if a set of numbers has aneven number of elements , 
18 separate years iri Table 3-4), the mediari will be the mean of the middle 
two numbers (in this case 65% and 63% as the 9th and 10th elements). 

**dther measures of variability are the mean deviation, variarice^ 

standard deviation, and coefficient of variation^ Standard statistics 

texts (Loether and McTavish^ 1975) and guides (Hammerstrom, 1976) provide 
explanations of such measures. 
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while the vertical scale is called the ordiaate (or y-axis ). The symbol 
X is used to designate the independent variable* i.e., that which 
"explains," "determines," or "affects" another variable. The symbol 
Y is used to designate the dependent variable, i.e., that which is 
"explained," "determined," or "affected" by another variable. Since 
one of our aims in obtaining information about policy outcomes is to 
explain why policy outputs and impacts differ, we often treat indicators 
of policy action as independent variables. For example, we may wish to 
graph the relationship between levels of expenditures for health care 
and the incidence of certain kinds of illness. 

One of the simplest and most usei'ul kinds of graphs displays a 
policy outcome variable on one axis (the ordinate) arid time on the other 
(the abscissa). If we wish to display information on the growth of publ 
welfare programs in the period 1950-1974i for example, we would con- 
struct a graph such as that presented below (Graph 3-1). 
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17.0 
16.0 
IS.O 
14.9 
13.0 

Welfare 12.0 
Recipients H-O 
(millions) 10.0 



9.0 
8.0 
7.0 
6.0 
5.0 

1.0 Tl- 



1 



1950 



1965 



1970 



1955 1960 

SRAPH 3-1 

Growth of Total Public 
Wel^faj^e^P^ogratns: Hill ions of 
Recipients in Selected YMri^4 950^1 975 



1975 



SOURCE: Adapted from Bye (1975:129.) 

Graphs may also be used to depict relationships between two or more 
variables (excluding time). One may wish to find out if one variable 
changes in the same direction as another— i.e. , whether the two variables 
are correlated positively. If one of the variables precedes the other 
iri time (e.g.* smoking precedes death from lung cancer) or if there is 
an available theory which explains the correlation (e.g.* the greater 
the income the greater the propensity to save), then we may wish to 



ERIC 



X.3i25 



157 



PUiblC POLICY ANALYSIS 



assert that there is a cauiat relationship between the two variables. 
Otherwise variables are simply cOrrelated- -one variable cannot be 
assumed to be a "cause" of the other. For example, wi may wish to 
display the association between the size of Standard Metropolitan 
Statistical Areas (SMSA's) and costs of public services per capita, 
as part of an effort to monitor the "fiscal crisis" of large urban 
areas. Graph 3-2 below shows a strong positive correlation between 
city size and the costs of municipal services. 




1,0 2.0 3.0 4,0 5.0 6.Q 7.0 8.0 9.0 
SMSA Population (millions) 



GRAPH 3-2 

Popul a tiofl^ Standard Hetropolitiari 
Statistical Areas by Average PubUc 
Service^j^endtturis Per Gaoita (1973) 

SOURCE: Adapted from T. Muller, Srbwinq and Decl ininq Ur^fl^ 
Areas: A F4s&al Cprocarison (Washington. O.C.: Urban 
'Institute, 1975). ^^'-^ 
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Ahbtfier wiy to display and interpret data dn the fiscal crisis 
of cities is the bar graph , which makes comparisons among values ex- 
pressed along pai-alled bars placed vertically or horizontally on the 
graph. The bar graph below (Graph 3-3). displays data on the relation- 
ships between total municipal personnel costs per capita in 1973 and the 
status of urban areas as growing or decliriihg in population In the period 
1960-1973. 



Total 
Personnel 
Costs 
(dollars) 



$700 
600 
500 
400 
300 
200 
100 



$140 





Growing 
Cities 



Dec! irilhg 
Cities 



New York 
City 



GRAPH 3-3 

T^ta^t^unj€4pa4^eFJ 



Costs 



Per Capita (1973) in Cities with Growing 
and Declining Populations in 1960-1973 



SOURCE: Adapted from Muller (1975), 
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Another way to display and Interpret data is with a histogram, a 
vertical bar graph which organizes irifonnatibh abcitit the distribution of 
a variable at on€ point in time. In a histogram the width of the bars 
is eqaal to the distance between intervals along the horizontal axis, 
there is no space between bars, as in a bar graph, because the scale is 
a continuous one (there are no discrete groups, as in Graph 3-3), the 
height of the bars in a histogram represents the frequency of occurence 
of each class interval (e-g., 0,0 to 1.0) along the horizontal axis. 
A histogram is one way to depict a frequency-d4Stribatjda , one form of 
which is the familiar "bell -shaped" or "normal" curve. If we are 
interested in minority perceptions of the quality of education we may 
wish to display data on the satisfaction of blacks with the amount cf 
education they have acquired. The histogram depicted in Graph 3-4 below 
shows that over half of all blacks are dissatisfied or neutral with respect 
to the amount of education they have achieved. The most frequent responses 
are in the extreme categories, i.e., completely dissatisfied and completely 
satisfied. 
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GRAPH 3-4 



Distribatibh of Satisfaction with 
Amowt g^f Education Among Blacks (N='202 ) 
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SOURCE: Adapted from A. Campbell, P.E. Coriverse^ larid W.L. 

Rodgers, The Qual44:y of American Life (1976), 459. 
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A frequency polygon is ahbtfier way to display data In which class 
frequencies are plotted on the vertical axis and the midpoints of each 
class on the horizontal axis. Graph 3-4 above can be transformed into 
a frequency polygon simply by placing points in the middle of each bar 
and cdrihectihg theni With broken lines. The essential difference Between 
a histograjn and a frequency polygon is that the latter uses a series of 
broken lines to represent the distribution of a characteristic such as 
satisfaction with educational achievement. 

When a large number of points can be placed on a graph and variables 
are continuous in nature (i.e.^ interval, ratio, and in special eases 
ordinal) it is possible to plot various kinds of trend-T4n^ . These 
lines may be "fitted" to the data points visually, although a number 
of statistical techniques are normally used to approximate the shape 
of curves. When time is plotted on the horizontal axis, trend lines 
are excellent means for monitoring and forecasting long-term movements 
in policy outcomes. Graphs may also be used to display and interpret 
the relationship between two variables, one of which may be taken as 
the explanation of the other. Graph 3-5, for examplei shows both the 
profile of data points arid a straight line representing a positive re- 
lationship between median family Incomes and per pupil expenditures in 
the United States, the oraph shcv^i that differences in median family 
incomes. In aria ,'zirig rfn;' probleij of inequality of ^educational opportunity 
this data may hav:: coh5vjeiable importarice iri expl::ring the possibility 
that social inequ^r. ;ties m>i be resolved before in«> "dualities oi" educational 
opportunity are successful .y reduced (lencks et al_. , 197Z). 



I'; puBtie pofcicy analysis 
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GRAPH 3-5 

Per PUpil Expenditures for Education 
And Medj^afl gamity Incoroes in the 50 States' 



SOURCE: Adapted from Dye (1975): 283. The 
plotting of states is approximate. 
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A final means for displaying and interpreting data oh policy out- 
comes is the cumulative frequency polygon (curve). The cumulative 
freauehcy polygon (curvej^ is either a broken-line or curve-line graph 
where the cumulative frequencies of a distribution are plotted along the 
vertical axis. On the horizontal, axis, as one moves from left to right, 
the first point plotted is the frequency of the first class; the second 
point plotted is the sum of the frequencies of the first and second 
classes; and so oh to the end of the scale, which is the sum of all the 
frequencies. .In monitoring the f_p^^_quences of policy actions designed 
to alleviate poverty* a highly useful cumulative frequency curve is the 
Lorenz Curvft, which displays the diistribution of income in a given 
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population (e.g., the country as a whblei a region, or a conriunity). A 
Loreriz Curve enables ds to compare the share of total income accounted 
For by each sucfcessive percentage of the jsopulatioh. These successive 
percentages of the population are measured in terms of quintiles or 
deciles.— i.e., classes or groups comprised of one-fifth or one-tenth 
of the population, which are ordered f; on lowest to highest in terms of 
their share of total incone. In graph 3-6 below the Lorenz Curve enables 
us to compare the distribution of ihcdme in the United States at three 
points in time. As the curve moves closer to the diagonal (line of equality), 
income becomes more equitably distributed, with total equality represented 
by the line of equality. While graph 3-6 provides a time comparison * the 
Lorenz Curve can also be used for sgatial_ comparisons of countries, states, 
regiohSi or communities. Ah additional advantage of the Lorenz Curve is 
that it is easily converted in the Gini index of inequality, which measures 
the area between the 'ne of equality and the curve. As this area becomes 
smaller, so does income inequality. The Gini Index ranges from 1.0 (per- 
fect inequality) to 0.0 (perfect equality). 
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Cumu4a4:i4/e-43 istrT bution of 



fml-ly Income 1ri 1929, 1962, and 1972 
SOURCE: Adapted from Dye (1975:98). 



10. List the appropriate measures of central tendency for each of the 
' four levels of measurerneht: nonrfnal, ordinal, interval and ratio. 



11. List the different ways to display data on a particular pblicv 
outcome (e.g., public assistance benefits in constant dollars)- 
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APPROACHES to MONITORING 

the systematic collection of relevant, reliable, and valid In- 
formation on policy odtcbmes Is one of the most Important aspects of 
policy analysis. Nevertheless, it may be difficult to see how moni- 
toring is actually carried out by program administrators, policy 
analysts, and socla'^ researchers who investigate policy problems. 
Fortunately thert are several identifiable approaches to monitoring^ each 
of which employs different methods to obtain information about policy 
outcomes. In this section we will briefly examine four such approaches: 
social- accounting, social auditing, social experimentation, and social 
research cumulation. 

In the mid-l9B0's a ritmiber of social scientists and pbl icy-makers 
began to advocate an approach to monitoring pol icy environments which 
often goes by the name social systans accounting (Gross^ 1965). Social 
systans accounting is a set of methods whereby changes in various events 
and conditiohs n^iy be systematically mohitdred over time. Sometimes social 
systans accounting includes special efforts to monitor particular conditions 
in soc1ety--e.g. i the quality Of working life (Davis and Cherhs, 1975; 
Report of the Special Task Force to the Secretary of Health, Education, 
r^tid Welfare, 1972), or the quality of life in municipal ar;eas (Flax, 

1974; Urban Institute, 1974), In one my or another each of these 
efforts uses social 1ndicators--fie. , quantitative and qua! itative measures 
r; cfe;hges in social conditions— to monitor society's progress in attaining 
certain goals and objectives. Om of the b^^ic assumptions of social 
systens accburiting is that th>? n^driitbring cf -gocl^al^ cbnditioris is equally 
important as the monitoring of econom4c cundluions. For this reason many 
persons have advocated the preparation of a "Social Report" comparable to 
the. President 3 Annual Economic Repo rt to the Nation, in 1969, for example, 
the Department ov Health, Education^ and Wslfa^e published a volume entitled 
-Tovard a-Sncla^l .^ ^ngrt. S^'nce 1973 the Department of Commerce has published 
3r annual compnation entitled Socis ! Indicators . 

An examination of the types of social indicators used for purposes 
of social systems accounting suggest:* the broad range of policy outcomes 
which can be monitored with JtMs approach. In effect* social indicators 
are used to mbrr^tor progress in achieving certain values or fulfilling 
cijrtalh needs- -i.e. i to detirtriihe the extent to which policy problems are 
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Being resolved, fable 3.5 presents such indicators, their observed 
values in selected years, and their ^pected values in terms of ob- 
jectives set for 1980. 



TABLE 3-5 

Selected Social Indicators: 
Qhsg r vgd an d Pj tngg t gd Va 1 ugs 



iiiu 1 wa uur 


Observed 


Expected 


Overall life Satisfaction 
[% persons moderately to 
completely satisfied) 


32. Ot (1975) 


Increase 


rersons.-in acate nen^ai 
Hdipl tals 


426,000 (1967) 


50,000 


I iirseT* tO - r 1 vC'T/ea r_ u i as 
111 School or Preschool 


35.25 (1967) 


95X 


P«rcnrK And Old^r who 

Graduate from High School 


51. iS (1167) 


65S 


Handicapped Persons 
Rehabilitated 


208,000 (1968) 


600,000 


Average Weekly WorkWeek 
(Manufacturing) 


40.6 (1967) 


37.5 


Labor Force Participation 
Rate for Women (aged 35-64) 


48S (1967) 


60% 


Average Annual Paid 
Vacation (Manufacturing) 


2 weeks (1967) 


4 weeks 


Percent of Populatlor. 
Below Poverty tevel 


12. as (1968) 


0.0 


Iflcoma of .Lowest Fifth 
of Population 


5.35 (1967) 


10. ot 


Persons Einployed 


83 ifiUlloh (1967) 


110 tnlllidh 



SOURCE: Adapted frditi U.S. Departmeiit of Ke<tlth, Education, and Welfare. Towrd 
a $6c1a 4-Repert (Ann Arbor: University of Michigan Press, 1970); and 
A. Campbell, P. Conye^ie, and W. Rodgers, The Quality of American Life 
(Mew York; Russell Sage Foundation, l97Sj. Expected values set for 
1980 are subjective estimates. 
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The use of social Indicators has several poisitive consequences. 
First, the attempt to select indicators appropriate for monitoring 
can result in the recognition that we do not have sufficient Information 
on the outcomes of public policies. While much progress has been made 
in systematically acquiring information on policy outcomes, it is still 
often difficult to obtain sufficient information to find out whether 
programs are achieving their intended impact oh target groups. (Rivlin, 
1971) Secbhd, when Information is obtained on policy outcomes, 

- - - - - - - - V. - - - . _ . . . 

particularly in terms of impacts on target groups i we can evaluate and 
modify public policies ^rii programs. There is a direct link between the 
adequacy of social indict !,ors and the quality r/r infonration about policy 
performance. Finally, social indicators can assist in providing information 
with which to identify new policy prdfalans and policy alterriatives. Social 
indicators thus provide information with which to Tionitor the consequences 
jf policy actions, evaluate different types of outcomes, and identify 
new policy prdblens and alternatives. 

Among the many criticisms of social indicators, several deserve 
special attention. First, it has been observed that the very choice 
of certain indicators (e.g., those to measure Income distribution) re- 
flects political biases arid value judgments. (Dye, 1975:336) This is 
certainly trues it is also normal, given that the very ideatif icatioh of 
policy problems is subjectivistic and artificial. Hence, new social 
indicators are rib more "biased" than those which have been used in the 
past (e.g.. Gross National Product," productivity, unemployment). Second, 
social irtdicatdrs may riot be directly useful to policymakers iri chddsirig 
different courses of actibri. In fact, there is some evidence that social 
iridicators are not perceived by policyntiakers to have great instrumental 
value--i.e., it is difficult to use the kinds of general infbrmatiori 
contained in social indicators to make concrelie decisions about specific 

programs. (Caplan et aT. , 1975) This criticism, while no dnubt importarit, 
overlooks that one of the main functions of social indicators is to 4dentify 
new problems, rather than provide clear guidelines fbr their sblutibri. A 
third criticism of social indicators deals with the type of indicators which 
are used. (Singh, 1975) Most indicators seek to measure objective conditions 
(e^g,, income distribution), often neglecting the sub jective perceptions of 
individuals and groups. Hence* what may be important is not so much that 
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income inequality is diminishing, but rather how such changes are perceived 
as stieh by groups with a strong sense of social injustice and rising ex- 
pectations. In other words, people are hot only deprived In terms of 
absolute differences in income or other resources, but relatively in 
terms of their own perceptions of thonselves in relation to others. Lastly^ 
the assumptions underlying the use of social indicators have been challenged 
on grounds that they reflect a commitaneht to "big government," "totalitar- 
ianism," or the "invasion of privacy." While such criticisms may have 
some validity, efforts to develop social sys .ms accounting are chiefly 
a response to problems of formulating public policies in complex post- 
industrial policy environments. Efforts to avoid the systematic collection 
of information are not likely to contribute to the resolution of coh- 
teSporary problems: pollution, poverty, drug addiction^ declining sat- 
isfaction with life and work, inequality of life chances for minorities 
and women, mental illriessi dropping out of school. Such criticisms often 
mistake symptoms for the problem. 

One of the shortcomings of social systans accouhtirig— ma inly, that 
the kind of informauidn generated is often too general to be directly 
useful to policy-makers— is to some extent compensated for by social 
auditing. In social auditing the Inputs of a particular policy or program 
"are traced from the point at which they are disbursed to the point at 
Which they are experienced by the ultimate intended recipient of those 
resources.". (Coleman, 1972:18) Social audits may provide specific infor- 
mation on policy and program outcomes, such that the inability to achieve 
a given policy objective may be traced to two factors (Smith, 1975:306): * 
(1) resource inputs (program personnel , person-hours, services, money) may 
have been insufficient; or (2) they may hot have reached target groups. 
While the social audit does not provide adequate information on policy and 
program impacts, it does provide measures of outcomes which "tell whether 
the resources are available at point of use, and if they are not, where and 
how they got lost." (Coleman, 1972:19) An additional advantage of the social 
audit, as compared with social accounting, is that it helps to focus on 
specific policy actions and outcomes within the definable contexts of 
particular agencies, rather than society in general. Nevertheless* the 
relative specificity of social audits can also be problematic, since it 
is generally more difficult to acqt^lre information for social auditing 
purposes than to compile social indicators from available public records. 
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One of the central features of social accbahtihg arid social atiditirig 
as approaches to mbm'toririg is that they occur after a policy or program 
has been implemented. One of the consequences of monitoring policies 
after the fact is that it may take a very large number of successes and 
failures to find out what works best and why. Rivlin (1971) has chara- 
Ct.rrized such ex post facto approaches as "random irtriovatiorii" i.e., a 
o-ncess of urisystaTJatieally fonmulating arid executing new policies and 
programs whose outcomes cannot easily be traced back to policy actions 
over which there is direct control. Random innovation may be contrasted 
with "syscematic experimentation," which is a method of social innovation 
which seeks maximum control over policy aetioris (inputs and processes) 
and the eonJ-lt-:oris undar which they are undertaken. The esseritial feature 
of social ^^er jine nt^tioo c ■; ari approach to moriitoring is that it occurs 
tefdre pbl icies ar^ recdmmeiided as solutions to given problems. Fair- 
weather (1967) and others (Caporaso and Roos, 1973) have advocatid social 
experimeritation as a means of solving social problems by investigating the 
probable outcomes of pol icies in selected demonstratiori projicts. Iri other 
words, social experiments are conducted prior to the comnitment of re- 
sources ':o large and costly new programs whose consequences cannot be 
predicted in advance. 

As an approach to monitoring* social experimentation closely follows 
methods used in classical scientific experimerits. (1) There is direct 
control over experimerital stimuli (policy actiOriS) and the conditions 
urider which they are implemented (different target groups with known 
characteristics). (2) At least two groups are moriitored. One, the "ex- 
perimerital" group, receives the stimulus or "treatment" (e.g., certain 
services), while the other— the "control" group— receives another stimulus 
(e.g., less services) or no stimulus at all. (3) Attempts are made to 
select target groups randomly, so that possible biases in selection are 
reduced, tastly, (4) precise measurements are made, such that any 
diffirences in the responses of the experimental and control groups may 
be monitored and used as a basis for formulating policies in the future. 

Perhaps the best known social experiment is the Mew Jersy-Pennsylvania 
Sraduatid Work Incentive Experiment, furided by the Office of Economic 
Opportunity as "an attempt to use the experimental method to answer some 
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of the policy questibriis that surrounded welfare reform 1h the niid-196Qs." 
(Rivlin, 1971:94) A random sample of able-bodied men aged 15 to 58 from 
low-income families was selected from three sites in New Jersey (Trenton, 
Patterson-Passaic, and Jersey City) arid Orie in Pennsylvania (Scranton). In 
each city some families received various combiriatioris of guaranteed annual 
income levels and tax breaks, while others received no payment whatsoever. 
Altogether, some 1,350 families participated in the experiment. 

Hanycritics of welfari programs expected that income supplements 
arid tax breaks (negative income tax) would induce low-income families to 
work less. This expectation, which derived in part from popular myths 
about the poor, was not substantiated by the experiment. The mairi result 
of the experiment was that the experimental (income maintenance) and control 
groups (no income maintenance) did not differ in their employment patterns, 
as reflected by chariges in earnings over the period of the experiment. In 
fact, as Table 3-6 shows, the earnings of the experimental group increased 
slightly as compared with the control group. 

TABLE 3-6 

Effects Of I ncome Maintenance on Earriihgs 
ofL 400 Low- 1 ncbme Fam i 1 i es^ in New Jersey 





Groups 


Family 
Earnings 


No Income 
Maintenance 
(Control ) 


Income 
.Maintenance 
(Experimental ) 


Increased 
No Change 
tccreased 


41.0% 

29.0 

30.0 


43.0^ 

28.0 

29.0 



100.0 



100.0 



SOURCE: A. Rivlin, Sy s tenia tic t H 1 n r-^i- - Socta-l-4ct i a n 
(Washington, D.C.: The Brookings Institution, 
1971) ♦ 100. The computation of changes in family 
earnings excludes government payments to the experi- 
mental group. 170 
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Social experiments such as those conducted in New dersey, Pennsylvania, 
and other states have the advantage of being able to show that is was 
certain policy actions (e.g., income maintehahce)— and not the character- 
i?tics of target groups or their surroundings— that resulted in given out- 
comes (e.g.i no changes in employment behavior). This feature of ex- 
periments is often described as internal validity— i.e. . the degree to 
which particular results can be attributed with confidence to experimental 
treatments or stimuli. At the same time social experiments also have 
Shortcomings and weaknesses. They often lack external val idity— i .e. . 
their results are difficult to generalize to other situations— mainly 
because the effort to conduct the experiment itself results in special 
conditions. Hence^ persons may behave as they do because they know they 
are participating in an experiment. Similarly, the more scientifically 
controlled the experiment, the less likely that conditions established 
during the experiment will actually be found in "real-life" or "natural" 
settings. Finfl^ly, there are ethical questions associated with social 
experimentation. It may well be unethical, for example, to provide some 
groups with money or services, while withholding the same benefits from 
others. 

A final approach to monitoring is what we might call social ^e search 
eumulatioE— I.e. , the systematic compilation and comparison of results of 
past research on policy outcomes and actions. Here, the assumption is that 
it may not alveys be necessary to engage in social accounting, social auditing, 
and social experimentation in order to obtain information on the affective- 
ness of a given policy. Rather we may be able to use the results of past 
research efforts to determine how a given policy worked in similar cir- 
cumstances. While it is true that many policiis have never been tried before— 
^•rid hence we cannot monitor outcomes before actions have been tak6n--it is 
true that a large stock of knowledge is available on policy processes, 
organizational structures and behavior, policy outcomes and impacts ^ and 
other facets of policymaking. Social research cumulation has two principal 
benefits. First, it provides js with various theo^ries and model s of pol icy 
action and policy outcomes (see Bower, 1958; Gergen, 1968; Schoetfe, 1968; 
towi, 1968, 1972; Dye, 1975). Such theories and models can be helpful in 
thinking about the kinds of policy outcomes which might occur under different 
conditions included within theories and models, thus, for example, theories 
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of conmunication may suggest that maximum policy impact in social service 
delivery programs occurs when service workers arid clierits have similar 
social background characteristics (age^ race^ social status* education), 
A second benefit to be derived from social research cumulation is the 
emp^irical generalizations about policy outcomes and actions present iri 
situatibris similar to those in which we are interested. For example, a 
recent compendium of empirical generalizations derived from'^over 1,000 
research projects provides us with information on policy and program out- 
cdrtieSi as well as action guidelines arid principles for planriing and or- 
ganizing social change, (Rothman, 1974) 



12. Compare and contrast social experimentation and social accounting 
in terms of the degree of control over policy instruments* the 
varl Idity of generalizations about policy outcomes, and the ethical 
implications of each approach. 



13* Compare and contrast " random irinovatibri" arid " systematic experi- 
mentation ," What are the strengths and weaknesses of each ap- 
proach? 



14, Urider what circumstarices might " random iriribvati'ort" be a better 
approach tfieri " systematic experimentatioji '^ Specifically, what 
are the implications of the notion of " Ill-structured- prj)b] ems " 
for this question? 
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SOME FALLACIES OF MEASUREMENT 

This unit has stressed the importsknce and desirability of employing 
precise measures of policy outcomes and actions. Systanatic measuranent 
procedures can be advantageous^ but they can also be abused. In this 
final section we shall, .therefore, review several of the major fallacies 
encountered in efforts to monitor the consequences of policy actions: 

1. Aggreqative^EaJIacy. The attempt to draw conclusions 
about individual behavior or attitudes on the basis 
of group (aggregate) data. For example, in monitoring 
changes in public assistance programs one may falla- 
ciously conclude that increases in welfare rolls over 
time reflect a decline in individual willingness to 
work, or changes in the work ethic ^ when the real 
explanation of the increase is rising unemployment 
rates and the breaking down of extended families. 



2. IhdiYidaaT^^c FaTTacjt. The attanpt to draw con- 
clusions about group {aggregate) behavibr or attitudes 
on the basis of knowledge about individuals. For 
example, in monitoring the impact of racial inte- 
gration in public schools, itmay be fbtirid that indi- 
vidual white and black Children are generally satis- 
fied with school integratibn. The same children may 
nevertheless develop widely different attitudes as 
classes change from a relatively hcmogeheous to a 
relatively heterogenepus racial comjsositioh. In- 
dividual attitudes change in group situatibhs. 

3- Fallacy of Misplaced Precision . The attempt to claim 
va 1 i d i ty f or one ' s - f i hd i ngs by using statistics and 
mathematical formulations may obscure the fact that 
data are unreliable or invalid. For example, in 
mohitdrihg crime and heroin addiction in New York 
City it wasiceported that addicts steal from $2 
billion to $5 billion in goods annually to support 
their habit. Upon careful review of these figures 
it was found that analysts had multiplied an es- 
timated 100,000 addicts by ah estimated habit of 
$30 per day. The resulting $1.1 billion was then 
multiplied by a factor of 4, since stolen goods are 
typically sold at one-quarter their real value. 
The known value of all goods stolen per year does 
not approach $4.4 billion^ suggesting either that 
there are far fewer addicts or that addicts steal 
less frequently than believed. 
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4. Fallacy^ of PsetJdb^PrQof , Efforts are made_ to claim validity 
for findings where there is no sound SCI ^ for 
doing so. For example, in monitoring the consequences 
of policy actions in the BO states, it is found that those 
states withcompetitive party systems allocate more of 
their §udgets_ to social welfare and education than states . 
with_non-competitive_ party systems. Subsequently, it is 
discovered that it is the level of ecdhomic development 
of states thataffects patterns of expenditures as well 
as party competition. In effects the correlation between 
party competition and expenditures was spurious--i .e. , 
only apparent but not real. 

Monitoring, as we have seen, plays an essential role in generating 
information about policy outcomes. Only by systematically describing the 
consequences of policy actions can we know whether a given policy is 
achieving its stated objectives. Monitoring requires precise measure- 
ment, careful definitions of relevant variables^ and skills in the pre- 
sentation and interpretation of data. Systematic monitoring procedures 
may be used to great advantage; they may also be misused, resulting in 
various fallacies of measurement. In either case, however, monitoring 
is essential for the policy-analytic of forecasting, which we shall con- 
sider in the next unit. 



15. Provide illustrations from your own experience of each of the 
faj_Tacie£ associated with the measurement of policy outcomes and 
actions. 
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. SELF-TESTING EXERCISE 

1. the use of the Consumer Ind3x to describe changes in prices 
over time is a good example of: 

(a) evaluation 

(b) forecasting 

(c) monitoring 

(d) recommendation 

2. "Monitoring is to forecasting as recommendation is to evaluation." 

(a) True 

(b) False 

3. "Monitoring is to forecasting and evaluation as forecasting and evaluation 
are to recommendation." 

(a) True 

(b) False 

4. Monitoring involves: 

(a) value premises 

(b) factual and value premises 

(c) factual pranises 

5. The choice of indicators used to monitor policy outcomes is and can 
be wholly objective: 

(a) True 

(b) False 

6. The median is the appropriate measure of central tendency for: 

(a) interval level data 

(b) nominal level data 

(c) ordinal level data 

(d) ratio level data 

7. Aconstltutive defi provides an unambiguous rule for linking 
concepts with obse 

(a' True - 
(b) False ^8 
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'^Satisfaction wjth sanU services was defined as perceptions of 
adequacy of waste CO 1 lection, which was measured by responses to 
questions asked by interviewers." This statement contains: 

(a) an operational definition only 

(b) constitutive and operational definitions 

(c) a constitutive definition only 

(d) no adequate definition 

An indicator of policy or program input might be: 

(a) salaries of program personnel 

(b) person-hours devoted to program activity 

(c) volume of services produced 

(d) quality of services provided 

(e) all of the above 

(f) a and b 

(g) a^ b* arid c ^^4^ 

Effectiveness generally refers to the degree to which preferred policy 
outcomes are realized. Efficiency, by contrast, generally refers to: 

(a) the amount of effort expended 

(b) the costs of a policy or program 

(c) the quality of a policy or program 

(d) the ratio of effectiveness and effort 

In monitoring the consequences of actions taken under a tax reform 
program designed to reduce inequal ities in the distribution of in- 
come we would most likely want to use the: 

(a) Gini Index 

(b) Consumer Price Index 

(c) Cdst-of-Living Iridex 

(d) Index of Unemployment 

data may be presented in tables which have one or more dimensions. The 
kinds of data which are displayed include means, medians, and modes. 

(a) True 

(b) False 
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13. Calculate the mean, median, and mode f6>^ the follbwirig set of data: 



EXPENDITURES OF STATE GOVERNMENTS AS 
A PERCENTAGE OF tOTAL GOVERNMENT 
EXPENDITURES IN THE U.S., 1902-72 



Year 


State Expenditures as % of Total 


1902 


6% 


1913 


9 


1922 


11 


1927 


13 


1932 


16 


1936 


14 


1940 


15 


1944 


3 




0 


1948 


13 


1950 


12 


1952 


9 


1955 


ii 


1960 


13 


1962 


12 


1967 


12 


1970 


12 


1972 


13 



SOURCE: Adc,, ed from Dye (1975:205) • 

Mean: 

Median: 

Mode: 

14. A Lorehz Curve is a good example of a: 

(a) Bar Graph 

(b) Cumulative Frequency Curve 

(cj Histogram ISO 

(d) Rrokpn-Hnp Graoh 
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15. A social experiment typically volves attempts to manipulate Input and 
process variables under sclent i rically controlled conditions. 

(a) True 

(b) False 

is. Social experiments often have high validity, but low 

validity, 

17. The acquisition of information to conduct a social c^uclit— -as com- 
pared with social accbuhtihg--is g^v orally: 

(a) less difficult 

(b) more difficult 

(c) equally difficult 

18, "Per capita income in the United States has grown steadily over the 
past three decades. This reflects increasing individual satisfaction 
with the quality of life." This conclusion is an example of the 

^aj individualistic fallacy 

fallacy bf misplaced precislbn 
.) fallacy of pseudo-proof 

(d) dggreqative fallacy 




EKLC 



PUBLIC POLICY ANALYSIS 



ASSIGNMENTS 



1. Construct constitutive and operational definitions for any five (5) 
of the following outcgme_variables. Note that a sample answer has 
been provided in the first row. 



Variable 


Constitutive Definition 


Qperatiohal Definition 


Program 
Expenditures 


The mdrietary value of 
inputs into a program in 
a given time period. 


Dollar costs of goods, 
services, and mges i . 
1977. 

. — - \ . . . — - 


Persbhnel 
Turnover 






Units of 
Service 





• 


Satisfaction 
with Services 





* 


Income 






Employment 






Income 
Maintenance 
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Variable 


Constitutive Definition 


Operational Definition 


Health Care 
Delivery 


...... 




Pollution 






Energy 
Consumption 







2. Listed belbw_ are several contemporary policy problems. Beside six f 6) 
of these problems provide an indicator or an index with which to monitor 
policy outcomes, impacts, inputs, and processes. Note that a sample 
answer has been prtjvicied in tie first row. 



Public Policy 
Problem 

r 


Outcome 


Impact 


Input 


Process 




Average 
Costs for 
Fuel Oil 




1 Total 
Ih^-estments 
- in 0iT 
Refineries , 


Volume of 
Interstate 
Oil Flows 


Increasing costs of 
home heating 


Temperature 
Levels in 
fleines _ 


Declining Quality 
of Transportation 
Services 










Inadequate 
Police Protection 










Rising Crime 
Rates 










Social 
Inequality 
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Public Policy 
Problem 


Outcome 


• Impact 


Input 


Process 


inflation 










Dec! ining 

School 

Achievement 










Increasing 
Drug Addiction 










Rising Welfare 
Expenditures 










Urban Fiscal 
Crisis 











3. the following assignments require that you display and interpret data 
in the form of tables and graphs. 

(a) Readthe following description of college enrollment patterns 
in 1966 and display data in tabular form. The table has been 
constructed below the description; you are to indicate the 
source of the data and place the data in those columns and rows 
which have been left blank : 

"Accdrdir^ to the U.S. Bureau of: the Census ( Current Povuiation Re- 

porisj Series 20, No. 133, 1969) there was a.zotal of 5, 999 j_000_ students 
betueen i4 and 34 ye^s of age enrolled in college in 1966.. Of this total 
l,_046j 000 attended S-r/em* adlleges_, jmd 4, 953,000 attended 4^i^ear colleges. 
Males comprised 3,710, 000 of the _total, females 2,Z89,000. Of .all males 
enrolled, 612,00j0 a?trf 3,099,000 aitended^_2r^year amd 4^year dolleges, ve^ 
spectivety. Compopable figwpes for woman are 435,0^^00 C2'ry ear c^^ 
and 1,854,000 X4^ye<xv college). When total enrollment is broken down by 
race, we find that whites cmd biaoks account for 5^625,000 and 374^000 
students, respectively. Among whites, 965,000 attended 2-yenr colleges, 
OB compared -•''^th blacks. Again amcrvg whites, 4,660/000 attended 

4'^yeaT colleges, as camfi^^xred h.iih 293,000 bldcko^,'^ 

)( 7 ^ 0 
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RACIAL AND SEXUAL COMPdSiTidN OF 
STUDENTS BETWEEN 14 AND 34 YEARS 
OF- AGE ENROLLED IN COLLEGES IN 1966 



Students 


Total 
Enrollment 


Colleges 


2-Year 


4-Year 


Total 


5,999,000 




4,953,000 


--Blacks 


374,000 






—Whites 




965,000 




'-■Males 


3,710,000 




3,099,000 


—Females 




1*854,000 





SOURCE: 



(b) In ^ . le of 3,000 blacks and whites the fpl lowing data 

jhv. i and race were reported. Among whites:18.4% earned 
»ess than $4j000i 24.4% earned from $4,00 to $7,999i 28.4% 
eiirned from $8,000 to $11,999; and 28.9% earned from $12,000 
to $16*000. Among blacks: 36.1% earned less than $4,000; 
25,8% earned from $4,000 to $7,999; 23.4% earned from $8,000 
to $11,999; and 14.7% earned from $12,000 to $16,000. Display 
these data in the blank columns in the table below. 





Race 


Income 
Level 


White 


Black 


Less than $4,000 


18.4% 




$4,000 to $7,999 






$8,000 to $11,999 




23.4% 


$12,000 to $16,000 







100.0% :::: 100.0% 
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(c) What does the above table suggest about the relationship between 
race and income? 



(d) The same sample of 3, S0D blacks and whitesjwas broRen down into 
those who had completed fi'^gh school arid college, of which there 
were 1,50S persbris; Among whites: 9.7? earried less than $4,S00; 
2D. 5% earned from $4, SOD to $7,999; 31,5% earned from $8,600 to . 
$11,999; and 38.4% earned from $12,000 to $16,000. Among blacks: 
ZQ.3% e^rried less than $4,000; 30.1% earned from $4,000 to $7,999; 
25.4% earned from $8,000 to Sll,999; and 2^.:^^ earned from $12,000 
tO-$16,0C0. Display these data iri the blank columns in the table 
below. 

INCOME LEVELS FOR 1,500 BLACKS AND 
WHITES WITH HISH SCHOOL AND 
COLLEGE EDUCATION 



Income 
Level 




White 


Black 


Less than $4»000 . 






$4»000 to $7,999 






$8,000 to $11,995 






$12,000 to $16,000 







100.0% 100.0% 



(1,350) (ISO) (1,500) 



(e) What does the above table suggest about the effects of education 
on the relationship between race and income? 
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(f) Oil the basis of ^■'t.* presented below in the table, construct a 
bar graph which tM^olays black and white median family incomes 
from 1947-1972. 



RE9IfiN INCOME OF BLACK AND 
WHITE FAMILIES, 1947-1972 



Race 




Year 




1947 


1960 


1968 


1970 


1972 


White 


$4*916 


- - - 
$6,857 


$8,937 


$10,236 


$11,549 


Black 


$2*514 


$3,794 


$5,590 


$ 6,516 


$ 6,864 



SQ KCE: Bureau of the Census, "The Social and Economic Status 
of Negroes in the United StateSj" Current Population 
Reports . No. 28 (1970) and No. 46 (1973). 

NOTE: Disregard the fact that the intervals between years are 
unequal . 



$12,000 
$10,000 
$ 8,000 
$ 6,000 
$ 4,000 
$ 2,000 - 



J I L 



B W 



B W 



B W 



-_J I L._„.i__ ...I. 

B W B W 



1947 



1960 



1968 



1970 



1972 
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(gj Construct a broken-llnegraph bh the basis of the same data dh 
median family incomes of blacks and whites from 1947-1972. Draw 
two lines, one for blacks and one for whites, and label theiii. 



$12,800 
$10,000 

$ 8,000 
$ 6,000 - 
$ 4,000 
$ 2,000 



1947 



1960 



1968 



1970 



1972 



(h) Return to question 3(b) above. Use the data in your table to 
construct two histograms which display the distribution of in- 
come among whites and blacks. Go back to Graph 3.4 in the unit 
narrative and stjciy it before you complete your answer. 



30 - 

25 - 

20 - 

15 - 

10 - 
e 

0 I 



30 
25 
20 

10 
5 



(.! $4000 38000 512,000 $16,000 



$ 0 $4000 $8000 $12,000 $16,0CO 
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(i) 



On the basis of the two histograms, draw a frequency polygon 
which displays the distribution of incojTe among blacks ai-id 
whites,_ Use separate lines to reprei^nt. tUcks and whites 
and label them appropriately. Re^^p 
(Graph 3.4 and text) to complete jt^.t- 



.0 the unit narrative 
pjiswer. 



36 
25 
20 
15 
Id 
5 
0 



S2Q00 $6000 $10,000 $14,000 



(j) The table below reports the nurber of criminal of fenses_ known 
to the police per 100*000 population. Known offenses are broken 
down into two categories— total _crimes against person and total 
crimes against prbperty--over the period 1960-72. Construct two 
curve-line graphs which display trends in crime rates over the 
peV'iod, Label the two graphs appropriately. 



GRIHEzRSTES IS THE UNITED STATES: 
OFFENSES KNOWN lOPOLieV PER 
100,000 POPULATION, 1960-i972 



Category 


Year 


1960 


1965 


1970 


1972 


Against Person 
Against Props rty 


148 


185 
1,250 


360 
2,381 


39B 
2,432 



SOURCE: Federal Bureau of Investigation * Uniform Grime Reports , 
1966-1971. 



NOTE: Disregard the fact- 1 Hat the intervals between years are 
unequal. 
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2*500 
2,300 
2il00 
i»900 
1,700 

1,500 
1,300 
1.100 

900 - 

700 - 

500 

300 

100 



1960 



1965 



1970 



1972 



(k) What do these graphs suggest about crime as a policy problem? 



(1) The percentage increase In crimes against property and crimes 
against person between 1960 and 1972 is 168% (person) and 166^ 
^property). How do these computations compare with data dis- 
played in graphic foni- above? Which is a better description of 
the "problem?" 
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Ifi the table below are.data oh the jserceritage distribution of 
family income by quihtiles in 1947 and 1972. Return to Graph 
3.6 and study it. Use this data to construct two Lorenz Curves 
which depict changes in the distribution of income between 1947 
and 1972. Label the two curves and the two axes. 



_ . PEBGENTASE 01 STR I BUT ION : OE FSM I L? 
PERSONAL INCOME IN THE UNITED STATES 
BY QUINTILES, 1947 AND 1972 



Quintiles 1947 1972 



Lowest 


5.0 


5.5 


Second 


11. d 


12.0 


Third 


16.0 


17 4 


Fourth 


22.0 


23.5 


Highest 


46.0 


41.6 


Total 


100.0 


100.0 



SOURCE: U^S. Bureau of the Census* Current 
^opujat^n^ RfeHOrts , Series P-.6Q, 
No, 80, 
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(n) Wnat does the Lorenz Curve suggest about poverty as a policy 
problem? If poverty and other problems are "artificial" and 
"subjective," how valid is the -infonTiation displayed by the 
Lorenz Curve? 
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ANSWER KEY FOR SELF-TESTING EXERCISE 



1. (c) 2. (b) 3. (a) 4. (c) 5. (b) 6. (c) 7. (b) 8. (b) 9. (f) 
10. (d) 11. (a) 12.' (a) 13. Mean = 11.1; Median = 12; Mode = 12 and 
13. 14. (b) 15. (a) 16. internal; external. 17. (b) 18. (d). 
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INTR00UeTI9N 



Policy alternatives are potential courses of public action available 
to realize hunari values or satisfy hiimari needs. Stated in another way» 
policy alternatives are those courses of action which may be cfiosen to 
resolve policy problans. Infbnnation about policy alternatives is brie 
of the most imjJbrtant compOrierits of policy analysis, since it is this 
kind of information which establishes expectations as to whether a prbblan 
is "solvable" or "unsolvable." One dilaruia facing the policy arialyst 
is tb know what. problem to resolve; but another is to know which course 
of action is likely to resblve that prbblan. Iri order to cbrisider courses 
of actiori the policy arialyst must have information about different policy 
alternatives and their consequences. 

Information about policy outcomes bn issue areas bf welfare, pollutio 
energy, and crime is bbtained by mbriitbririg the corisequerices of policy 
actions. Iri turri, irifonnatiori about policy outcomes is riecessary fbr 
identifying policy prbblans. It should be clear that the reliability, 
validity, arid relevance of irifonnation about policy outcomes has a great 
deal to do with the ways that pblicy prbblans are identified. For example, 
popular myths about the "causes" of iricreasing welfare rolls are often based 
bri unreliable, invalid, and irrelevant infbrmatibri. This iriformatibri never- 
theless results in expectatioris that certairi kirids of alternatives (making 
welfare legislation more strict) will resolve the "prbblan," while others 
(creating more employment) will not. Iri other words, policy problems in- 
clude sbme alternatives: arid exclude others. Problems themselves may be 
raisideritified because of unreliable, invalid, or irrelevant information 
about policy butcbmesi 

Informatibn about policy prbblims is transformed into infonnatibn 
abbot pblicy alternatives through the use bf forecasting procedures. Policy 
prOblaiis--whether their definition is appropriate Or inappropriate 
(Error III)~are the basis for forecasting alternative cburses of action 
to resolve the problan. The fact tRat alternatives are "problem-dependent" — 
i.e., the selectibn bf alterriatives is regulated by the vay that the prbblan 
was initially ideritif ied--raises important questioris for public jaOlicy 
analysis. For example, if pblicy problems are subjective, artificial, 
dynamic, infinite, and interdependent, how wiJT- w« know if we have selected 
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LEARNlNe GBdEeflVtS ■ 

After completing this module you sfiduld be able to: 

1. Identify the essential characteristics of forecasting as a 
policy-analytic procedur^e. 

2. Recognize relationships among policy outcomes^ policy 
prbbleraSi and forecasting. 

3. ebmpare and contrast different approaches to forecasting used 
by policy analysts. 

4'. Apply selected forecasting procedures^ to policy problems. 

5. Recognize strengths and limitations of different forecasting 
procedures . 
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KEY TERMS 


AND CONCEPTS 


♦ Forecasting 


• 


Intuitive Forecasting 


9 Extrapolation 


m 


Intuitive Planning 


d Trend 


m 


Theoretical Forecasting 


^ Time Series 


m 


Theoretical Planning 


0 Secular Trend 


m 


Nomo logical Forecasting 


9 Cyclical Fluctuation 


m 


eiinical Forecasting 


# Seasonal Variation 


m 


Analogy Forecasting 


i rrcyu 1 Qi riwvciiicnu 


m 


Modelling Forecasting 


© Growth (S-shaped) Gurve 


m 


Extrapolati ve Forecasting 


# Peak 


• 


Survey Forecasting 


^ Trough 


• 


Normative Forecasting 


^ Trend Line 


• 


Multimethod Forecasting 
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OVERVIEW 



dbjectives 


Tasks 


Resources 


Evaltiatibri 


1. Identify the 

essential character- 
istics of forecasting 
as a policy-analytic 
procedure. 


Study Questions 
1,2,3 

Test Questions 


Unit 
narrative 


Self 


2. Recognize relation- 
ships between policy 
prpblems, policy : 
outcomes, and fore- 
casting. 


Study Questions 

4,5 : 

Test Questions 
3,4 

Unit Assignment 
1 


Unit 
flarrative 


Self and 
Instructor 


3. Compare and contrast 
different approaches 
to forecasting used 
by policy analysts. 


Study Questions 
6,7,8 
Test Questions 
5,6 

Unit Assignment 
2 


Unit. _ 
narrative 


Self and 
Instructor 


4. Apply forecasting^ 
procedures to policy 
proD i ems • 


Study Question 

_ 9 

Test Questions 

7,8 . 

Unit Assignments 
3,4 


Unit • 
Narrative 


Self and 
Instructor 


5. Recognize strengths 
and limitations of 
different forecasting 
procedures. 


Study Questions 

_10,11_,12_ _ 
Test Questions 
9,10 


Unit 
i^arrative 


Self 
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the right alternatives to resolve the problesn? Which courses of action 
shall we forecast into the future? If we have forecast the wrong courses 
of action, how meaningful is any information about the probable consequences 
of different alternatives? 

The above questions highlight the importance of policy problems in 
shaping the use of forecasting procedures. Forecasting is one of the 
most complex procedures used by policy analysts* primarily because we 
lack adequate information about policy outcomes and policy problems- Never- 
theless * forecasting is essential for rational choice of any kind, since 
it permits us to assess the consequences of different courses of action. In 
this module we shall examine: (1) the nature of forecasting as a policy- 
analytic procedure; (2) similarities and differences among various 
app: jaches to forecasting used by policy analysts; and (3) strengths and 
weaknesses of different forecasting procedures. 
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THE NATURE OlF FOREeASTINS 

In the past decade there has been a renarkable increase in the use 
of various new forecasting procedures by policy analysts. While generations 
of economists have used forecasting procedures to project trends in econoitiic 
factors such as anployraerit* investment, and income, it is only recently that 
methods of social forecasting have come into wide use. A', th^ present time 
various forecasting procedures are used to project the consequences of a wide 
array of social conditions. Forecasting is used to project patterns of 
ecdhoimc growth, population decline, ecological degradation, political 
apathyi general life satisfaction, qual ity of 1 ife, fiscal decline, and 
agency workloads, the use of forecasting procedures cuts across all societal 
activities, levels of government, and policy issue areas- 
Forecasting involves thi making of factual statements about the 
future on the basis of knowledge of past events or conditions. In policy 
analysis, forecasting procedures are used to predict the consequences of 
alternative courses of public action and inaction. Forecasting involves 
the systanatic analysis of expectations about future events, such that 
explicit comparisons may be made among different policy alternatives. 
Forecasting usually excludes attempts to select alternatives by Comparing 
then with stated preferences or values— i.e., forecasting involves factual 
rather than value praiiises. Reccnmendatioh--as distinguished from fore- 
casting—involves both factual and value premises about the future. Therefore, 
forecasting is a prerequisite for reconmehdation arid an important tool for 
more effective policy forniatibri. 

Forecasting may bi applied to various kinds of problems. First, 
forecasting may be used to predict ehangis iri policy environments which 
are likely to occur if governments take no further action, i.e., if they 
maintain the government status qtjo. For example, forecasting procedures 
are employed to predict the probable growth of pollution, given existing 
levels of government regulation of industry and consumer behavior. Similarly, 
forecasting may be used to predict an agency's caseload in the next year, as- 
suming that agency procedures, rules, and expenditures remain the Same. Second, 
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forecasting may be used to predict changes in policy envirdnmerits which 
are likely to occur if new policy alternatives are chosen— i.e., if govern- 
ments take new actions. For exainple, forecasting is employed to compare 
the probable consequences of different types of public assistance programs 
(traditional welfare programs vs, income maintenance programs) in reducing 
welfare roles or changing employment patterns. Third, forecasting may 
be used to predict whether certain kinds of policy alternatives will 
actually be adopted or implemented by public bodies or organizations. 
For example i forecasting^ may be used to. estimate the chances that Congress 
will approve certain kinds of legislation (such as national health insurance). 
Fourth, forecasting may be anplbyed to predict whether particular policy 
actors-- e.g. , Congressional conmittees, agency heads, political parties, 
organized interest grbups--will exert sufficient influence to facilitate or 
block the acceptance of given policies. Finally, forecasting may be used to 
predict two or more of the above types of cdriditioris or events at the same 
time. In other words, forecasting may be applied to different objects^ of 
analysis. 

1. Changes in pol icy environments if n£ further public 
action is taken; 

.2. Changes in pol icy enviornments if new policies 
are adopted; 

3. Changes in the content of public policies; and 

4 . Changes i n the i nfluence of poTicj^actor^ i n 
formulating and implementing public policies. 

Threa of the most cormionly employed bases of forecasting are intuition, 
theory, and extrapdlatidri. Forecasting may be based dri intuition , 
including subjective judgments, speculation, or educated guesses. A 
large number of public and private organizations use intuitive forecasting 
to project future workloads, expenditures, and demand for goods and services. 
Forecasts are also made on the basis of th^r£--i.e., general knowledge 
of cause and effect relationships. A good deal of the forecasting which 
underlies special education projects supported by the government is based 
on various theories of learning developed by educational psychologists. 
Lastly, the extrapolation of past events is one of the most prevalent 
bases of forecasting. In this case, forecasts about future events are 
based dh assumptions that trends observed in the past will continue into 
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the future. For example, historical patterns of growth in government 
spending may be extended into the future by maiking assumptions that the 
future will eoriform to thi past. These three bases of forecasting — 
intuition, theory, and extrapolatibh--are illustrated below in Table 
4.1. It should be rioted that forecasts made on different bases can and 
do conflict with one another. 



TABLE 4.1 

Forecasts arid Their Bases in 
Two issoe^Areas 



Issue-Area 


Basis of Forecast 


Intuition 


Theory 


Extrapolation 


Grime 


Grimes against 
person will 
rise at ah 
ever increasing 
rate. 


Crime is a 
fuhtion of 
joblessness; 
crimes will 
decrease as 
jobs increase. 


Based on past 
trends, crimes 
against person 
wil 1 increase at 
a slower rate than 
crimes against 
property. 


Welfare 


The rich Will 
get richer and 
the poor will 
get poorer 


Social in- 
equal ity is a 
function of 
education; in- 
creased educa- 
tional oppor- 
tunity wi 1 1 
result in 
greater social 
equity. 


Trends in the 
1947-1972 period 
show that incomes 
have become more: 
equitable. This 
trend will continue 
in the future. 



The main difficulty with intuition as a basis for forecasting is that 
different persons often reach entirely different predictions of future 
events. While we will discuss several ways to overcome this problem below, 
the main weakness of various forms of intuitive forecasting is that predictions 
are unsystanatic, implicit, and cannot easily be repeated by others. More- 
over, intuitive forecasts may actually be social myths in disguise— i .e. , 
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half-truths or distortions which may help to make sense out of complex 
policy problenSi but nevertheless result in self-fulfilling prophesies. 

Sciehtii^ic theories might appear to provide a firm basis for fore- 
casting. Such theories, however, contain their own myths in the fdnn 
of different scientific paradipis and ideologies. Moreover^ there are 
far fewer policy-relevant scientific theories than is coirinbnly believed. 
When such theories are available, they are typically much more useful 
in explaining negative characteristics of society as a whole — e.g., 
theories of inequality, urban squalor, ?ind collective violence—than in 
suggesting specific renedies (Williams, 1971). 

Perhaps for the above reasons extrapolation is brie of the most 
commonly used methods for systematically forecasting future conditions. 
The chief assumptibri bf extrapolation is that patterns of events which 
occured in the past will continue unchanged in the future — e.g., rates 
of growth or decline will ranain constant over time. A trend is a pro- 
jected pattern of events based on extrapolation. As compared with in- 
tuitive forecasts and many social theories, extrapolative forecasts have 
two main advantages: they are based on systanatically acquired infbrmatibri 
arid they make their assumptions explicit. The main advantage of extrapolation 
is that .assumptions of historical cbritiriuity may ribt be justified^ sirice 
the past may not repeat itself in the same form. Extrapolative forecasts 
are essentially assertive iri riature--they assert that future events will 
occur in a certain my, but do not explain why. Lastly, extrapolations 
bfteri cbritairi a built-in conservative bias, since they tend to use the 
past as a standard of what is possible iri the future. Fortunately, 
We are riot compelled to accept any one of the three main bases of 
forecasting as the sole guide to arialysis; this would result brily in 
dbgmatisni and error. We can use multiple methods— intuition, theory, 
and extrapolation— as bases for fbrecastirig. 

Qne of the most impbrtarit methbds bf fbrecastirig is time series 
arialysis. Tim e series analys is projects statistical information about 
past events iri order to make estimates of future ones. In time series 
analysis statistical data on a subject of interest is first arrarigid iri 
chro no logical* order. Past patterris are theri surnmarized with numbers 
(e.g., averages) and projected into the future. For example, iri irivesti- 
gatirig the eriergy crisis we may wish to project changes in sources of 
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electricity to the year 2000. Table 4-2 below forecasts decreasing 
reliance on oil,. gas, and coal between 1970 and 2000. 

TABLE 4.2 

Ch a nges in S our c es of 
Electricity, 1970-2000 



Source 


' Year 


1970 


1975 


1985 


2000 






Oil 


5% 


8% 


10% 


9% 


Gas 


29 


21 


12 


10 


Coal 


56 


48 


40 


33 


Other 


10 


23 


38 


52 


Total 


100^ 


100% 


100% 


100% 



SQURGE: doint Eonmiittee on Atomic Energy, "Certain 

Background Information for Consideration 

When Evaluating the National Energy Dilejnna" 
^Hashingtoh: U.S. Government Printing_^ ' 
Office, 1973); and B. Hughes, tUS^ Energy. 
Erivirdhmepti and Economic Problems : A 
public Policy SimSlatibh (Washington : 
American Political Science Association, 
1975), 26. 



Classical time series analysis, which has most often been anployed by 
economists, is concerned primarily with the projection of economic trends. 
It is "a descriptive method which attempts to break down an ecbriomic time 
series into distinct compdhehts which represent the operation of groups 
of explanatory factors..." (Hamburg, 1970:542). These factors might in- 
clude weather conditions, customs, consumer tastes, and technology. These 
factors might be arranged in several different kinds of patterns: (1) SecUl 
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trend s are relatively smooth upward or downward movenients over a period 
of 15-20 years or more- (2) Cyclical fluctuations are recurrent upward 
and downvard movenents around a secular trend line over periods of 10-15 
years or less, the duration of such fluctuations is measured by cal- 
culating the distances between troughs (the lowest point in a cyclical 
fluctuation) and peaks (the highest point in a cyclical fluctuation). 
(3) Seasonal variations are patterns of movanent within a time series 
which occur in defined periods of time (e.g.* years^ quarters, months). 
Seasonal variations occur within specified chronological intervals, 
whereas cycl ical fluctuations do not. Seasonal variations may be due 
to weather, customs, or holidays. (4) Irregular movenents are repre- 
sented by fluctuations that follow no consistent pattern, either 
chronological or recurrent. Irregular movenents are "residual var- 
iations"— i.e. , sporadic, unpredictable, or unknown factors which are 
"left over" after secular trends^ cyclical fluctuatibris, and seasonal 
variations have been taken into account. Among common sources of irregular 
movenents are wars* natural disasters^ strikes^ arid completely unknown 
factors. 

We shall concentrate now oh methods for estimating secular trends, 
since this component of time series analysis clearly illustrates the meth- 
dddlbgical strerigths and limitations of extrapolation. Secular trends 
are likely to be found in relatively stable environmerits mbriitdred over 
long periods of time. Secular trends are evident in the growth of goverh- 
merital expenditures, national income, costs of municipal services* and 
the number of governmental drgariizations . For example, ah important re- ' 
cent stydy (Kaufman', 1976) uses time series analysis to demonstrate an 
exponential growth of governmental orgahizatidris from roughly 1865 to 
1973. Over most of this period the number of federal agencies has grown at 
an ever increasing rate, suggesting that the expansion of government may 
resenble growth curves used to represent changes in biological organisms. 
Growth (S-sha^^ed^-^wves^ are characterized by slow rates of change at the 
beginning of a time period; subsequently one firids ever iricreasirig rates 
of growth up to a certain point, after which the rate of growth begins to 
decrease and level off. Cumulative tdtals of gdvernmerit orgahizatidris 
that survived until 1973 are illustrated in Graph 4-1, which depicts a 
secular trend in the grdwth df federal agericies thrdughdut most df the 
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nineteenth and twentieth centuries. Whether the growth of goverranent 
organizations will continue at the same rate^ or level off in future* 
is an open question. 




1789 1800 



1820 



1840 



1860 



1880 1900 



1920 



L940 



1969 1973 



8RAPH 4-1 

Cumuliiive Totals of Orgariizatidns that Survived 
to 1973, by 4- ^nty-Year Interv a ls . 1789- 1973. 



SOURCE: H. Kaufman, Are^^gvern ment Org a ni z at ions Immortal ? Washington, 
D.C.: The Brookings Institution, 1976, Adopted from Figure 4, 
• 62. 
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The main problen enebuntered in estimating secular trends is how 
best to describe them. On the one hand, it is not difficult to visually 
examine a secular trend as depicted in Graph 4-1 above; we can easily 
describe the overall movonent in the number of organizations over time. 
Oh the other hand^ it would be extremely difficult to provide ah un- 
biased guess as to what the secular trend would look like in the year 
2000. For this reason methods have been devised Which allow us to 
calculate a tre nd 1 ine . Such a line summarizes past and future changes 
in the magnitude of conditions over time. 

Lh determihirig the trend line of a time series such as that depicted 
in Graph 4-1 we would follow several steps: 

1. Establish the time period of: interest (1860-1970) 
and its intervals (units of 20 years). 

2. Make necessary adjustments for factors Which should 
be taken into account in order to interpret the 
trend. (e.g^i subtract the number. of organizations 
dissolved from those newly established in each 
time period). 

3. Plot the valuis (e.g.* cumulative totals of or- 
gahizatidris) for each successive time period. 

4. Fit a trend line to the points on the graph, 
either by hand and visual inspection (the _• 
so-called "black thread" method), by statistical 
calculations (averages and rates of change), 

or by solving mathenatlcal equations. 



5. Extend the trend line to any point of time in 
the future (e. g., 2000), .obtaining the projected 
number of organizations from values on the 
vertical axis; dr chpose_the time point and 
calculate the_ projected number of organizations 
from data on established rates of change. 



Where Graph 4-1 is fitted with a trend line extending over the 
period 1860-2000 we find that the projected number of organizations in 
the year 2000 is approximately 431. This straight line trend is illustrated 
in Graph 4-2 below. 
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GRAPH 4-2 

StrcUgfit^L lne T ^&\ <i Fit ted to Cumulative 
totals of Organizations. 186e-2Q6a 

SOURCE: Adapted from Kaufman (1976)* Figure 4, 62. 

Straight line trends such as that illustrated in Graph 4-2 are not 
appropriate for all forecasting problems, fl) A straight line trend is 
appropriate for relatively smooth secular movements, but not for the kinds 
of non- linear patterns encountered in the analysis of cyclical fluctuations 
and seasonal variations. (2) A straight line trend is essentially non- 
gredi^tive . this iS; because there is rid theoretical basis for explairiirig 
Why any secular movement did occur in the past or if it may continue 
•Into the future. (3) The extrapolation of straight line trends has a 
conservative bias, since it suggests that what has occurred will occur in 
the future. This kind of bias can severely limit the cofisiderations of 
possible alternative futures. (4) Straight line trends are appropriate 
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for iosa^tem movements (15-2(3 years), but not shorter ones. (5) 
Similarlyi the estimation of such trends requires that the environments 
in which they occur are relatively stable ones; the more dynamic or 
erratic the ehvirohmeht, the less applicable are forecasting methods 
based on the extrapolation of straight line trends. Lastly, (6) the 
kinds of data usually available for time series analysis of secular 
trends are sometimes only indirectly relev a^4 to public policy. Economic 
arid deriographic data, for example, is seldom appropriate for forecasting 
changes which are, in fact, due to particular policies, largely because 
such policies are drily remotely related to social arid demographic factors, 
such as urbanization arid health. Even less often available data helps 
to forecast changes in the content of particular policies or changes in 
the involvement arid influence of policy actors. 



STUDY QUESTIONS 

Ariswer each of the questioris that follow: 

1. flow does the reliability arid validity of information about policy 
outcomes affect the success of forecasting? 



2. List several ways that forecasting can contribute to greater 
control and coordination of policies. 
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3. Gbrapare arid contrast intuition, theory, arid ©ctrapolation as 
batses of forecasting. 



4. Which bases of forecasting are most appropriate for policy 
.problens that are subjectivistic, dyriamie, and infinite? 



5. Which of the three bases of forecasting is probably least 
affected by popular myths about policy problems? 



6 Which of the three modes of inquiry (dialectical, deductive,^ 

iriductive) is most closely associated with intuitive, theoretical, 
a.nd multimethod forecasting? 
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APPROACHES TO FORECASTING 

A range of problems associated with time series analysis and the 
extrapolation of secular trends have given rise to a variety of different 
approaches to forecasting. Some of these approaches are quantitative; 
others are qualitative and require no particular application of 
statistics. Some approaches are systematic* in that they state 
assumptions explicitly and follow formal methodological procedures; 
others are essentially unsystematic, since they leave assumptions vague 
and follow no recognizable method. Finally, some approaches to fore- 
casting seek to predict changes in variables which are part of existing 
policy processes— e.g. i the probable influence of policy actors in 
resolving an issue-- while others attempt to forecast changes which are 
part of the policy environment. 

Perhaps the best way to corapare and contrast different approaches 
to forecasting is to apply the two major dimensions of forecasting dis- 
cussed in the preceeding section--i.e* j the basis and the ob ject of 
forecasting. As you will recall, there are three primary bases of forecasting 
intuition , theory , and extra^o1at4^ . The objects of forecasting dis- 
cussed above— i.e., changes in policy environments without public action ^ 
changes in environments with public action, changes in thecontent of 
policies, and changes in the irifluirice. of policy actors—may be grouped 
into three major categories: po^4cy-env i ronrnent , public policies , arid 
policy actors . These three categories of types of objects, you will re- . 
call, represent the three principal elanerits iri a policy system (Module 1). 
If we cross-classify these two dimerisidris--i.e. , the methodological basis 
and the object of forecasting— we possess a framework which is useful in 
distinguishing various approaches to forecasting. Table 4-2 shows the 
primary methodological basis and object of different approaches to fore- 
casting now in use by policy analysts.* 



★Table 4-2 shows the primary methodological basis and object of ^ 
approaches now in use. Because a_ particular approach is based pr imaril 

on intuition arid directed primarily to pbl icy environments does not 

mean that the same approach might not have a different basis and object 
in given instances. 
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Nethodblogica] Basis 


Primary Object of Forecast 


Policy Environment 
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Pablic Policies 
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Policy Actors 


Intuition 


Intuitive Forecasting 


Intyltive Planning 




Theory 








Nomological Forecasting 
Theoretical Forecasting 
Modelling Forecasting 


Theoretical Planning 
Normative Forecasting 


Analogy Forecasting : 


Extrapolation 


Extrapoiative Forecasting 
Survey Forecasting 




elinical Forecasting 
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Iritoitive forecasting involves the estimation of future cbriditioris 
in a policy environment by persons who are assumed to have some special 
competence in a given issue area. Intuitive forecasts are made by in- 
dividuals as well as groups. They may be systematic and formal * or 
unsystatiatic arid ndri-^fdrmal . Assessments of future conditions by 
individual scholars and social critics— e.g. , assesanents of the state 
of a nation iri the year 2000— are often unsystematic and non-formal , 
since such forecasts are based largely on speculation and educated guesses. 
The difficulty with such forecasts is riot so much that different individuals 
can and do reach entirely different assessments of the future; it is 
rather'that we do not know how they reached such assessmerits or what in- 
fbrmatibri was used to reach conclusions. In effect, unsystematic arid 
non- formal intuitive forecasts place primary reliance on the authority 
of individuals arid groups— e.g., experts religious spokesmeri, gurus— 
rather than the expew'ence^ and met^ds which underlie a particular fore- 
cast- 
Such difficulties have led to a variety of methods for systematically 
comparing and summarizing the judgments of experts. These methods include 
special coriferericing techniques , which seek to bririg together groups of 
experts .in the same location (conference task groups) or through 
cbmnuriicatibris media (cbmputer arid telephoriic cbriferericirig) . Perhaps the 
most well-known and prevalent method for systematically generating expert 
bpinibri is the Delphi method ^ which uses groups of expert judges whose 
collective assessments of future conditions are generated in a series of 
steps: (l]f each expert judge is requested to offer an assessment of 
future conditions (e.g.* the exterit of ecological degradation in the year 
2000, assuming that no further governmental regulation occurs); (2) each 
expert's fbrecast and its basis is systematically recorded; (3) the 
similarities and differences between forecasts, as well as their bases, 
are reported back to each expert judge; (4) each judge is asked to offer 
a revised forecast on the basis of information abbut similarities and 
differences iri the group as a whole; and (5) revised forecasts are again 
systematically recorded. The Delphi technique may involve many iteratioris — 
i.e^ successive revisions on the basis of new information--and the typical 
objective is to create consensus among expert judges. The advantage of 
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thi Delphi technique is that it makes the basis of forecasts explicit 
and enploys systanatic methods. Its main disadvantage is that it places 
primary reliance on authority (i.e., "experts") and tends to force con- 
sensus prematurely in situations where conflict may be beneficial. Never- 
theless^ the Delphi technique may be based on inductive (cohsehsaal ) as 
well as dialectical (confl ietual ) strategies of inquiry. 

Whereas Delphi and conferencing techniques typically use intuition 
as a basis for forecasting changes in policy environments, intuitive 
plawting uses intuition as a basis for estimating probable changes in the 
content of policies, the behavior of policy actors, and the consequences 
of both the changes in policy environments. Intuitive planning— which is 
best illustrated by efforts of public and private managers to riach the 
subjective estimatis of probable changes in target groups, budgets, and 
workloads— tends to be non-explicit and non-reproducible. Nevertheless, 
there are methods available to systematize the process of intuitive plahhihg, 
including Bayesiah decision analysis , which involves the application of 
statistical probability theory to hunches, personal speculation, and 
educated guesses. The essential characteristic of Bayesian analysis 
is that it relies on "prior probabil ities"~i.e. , assessments of probable 
future conditions which ari based on intuitive judgments, rather than 
objectively verifiable information. As with methods of intuitive fore- 
casting discussed above* Bayesian decision analysis is most useful in 
situations where information is either absent or highly unreliable. 
The advantages of Bayesian analysis is that it is explicit and reproducible j 
its main disadvantage is that it placis primary reliance on m&t^ods^, often 
to the ejcclusion of exper4^<iee^ acquired through systanatic observation. 

Nomoloqical forecasting (the Sreek work nomos means "law") attempts 
to predict changes in policy environments on the basis of knowledge of 
social "laws"--i.e- , universally valid and invariant relationships such as 
those contained in the law of gravity. Invariant patterns of action in 
society are used as bases for predicting the future. Thus, the example, 
"laws" of boreauratic growth sometimes hold that a process of increasing 
authoritarianian is one of the major characteristics of modern societies. 
If such "laws" are in fact valid, forecasts should reach conclusions that 
bureaucratic el ites— rather than citizens in a democratic society— will 
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increasingly dominate policymaking. In effect, policy environments 
will be composed increasingly of apathetic or powerless citizens who 
have less and less control over decisions which affect their lives. 
The main advantage of nbmological forecasting is that predictions are 
esxplicity derived from theories about social processes. Because the 
basis of forecasts is explicit, predictions eah be challenged with new 
evidence. The weakness of such "laws,'' however, is that they are not 
easy to prove; in fact^ many have been successfully challenged through 
various research efforts which show that social processes such as 
"bureaucratization^" "technological progress," and "social disorganization" 
are much more complex and unpredictable than advocates of theories admit. 
In short, attempts to forecast future conditions dh the basis of "laws" of 
politics, economics, or society have not been particularly successful. 

Theoretical forecasting is also derived from explicit assumptions about 
social processes. One of the essential differences between nomological and 
theoretical forecasting is that the latter is tentative and open to new 
evidence. Attempts to apply theoretical forecasting to changes in policy 
erivirdrimerits^-e.g. i attempts to predict the increasing role of knowledge 
and expertise in post-industrial policy environments— typically offer pre- 
dictions in the fdrm df hypotheses (i.e.^ conjectures) which can be accepted 
or rejected oh the basis of hew evidence. The advantages of theoretical 
fdrecasting include expl icitness, a primary reliance dn experience* and 
a capacity to learn from failures as well as successes. Theoretical fore- 
casting has no disadvantages that are not also shared by other approaches . 
to forecasting, including ah inability to deal with uncertainty, limited 
information, and erratic changes in policy environments. At the same time 
most social sciences disciplines^ with the possible exception of economics, 
have not yet provided many social theories which actually contribute to 
effective social prediction. 

theoretical planning is closely related to theoretical forecasting. 
The main difference is that theoretical planning is explicitly concerned 
with changes in the content of public policies arid the behavidr df policy 
actors. The main purpose of theoretical planning is to produce a plan of 
actiori. Forecasts assume the fdrm of predictions about what will occur if 
particular plans or policy alternatives are adopted^-e.g. , low-income 
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persons will seek to increase their incomes if provided with a guaranteed 
annual income, since all human beings wish to maxmize their own welfare; 
Advantages and disadvantages of theoretical planning are identical to those 
of theoretical forecasting, with one significant exception: theoretical 
planning, while action-oriented, requires that public policies ari actually 
adopted before predictions may be tested. Since it is easier to propose 
a policy than to gain acceptance for its adoption, theoretical planning 
is heavily dependent upon the assumption that policies will in fact be 
carried out. 

ModeUinq forecasting is also based on theory, except that predictions 
are derived frOm a small set of variables that are part of a larger theory. 
A model is a formal representation of a theory Which typically uses 
quantitative terms (e.g., numerical values in mathatiatical equations) to 
express relationships among variables. For example, • economic forecasting 
models use quantitative terms to express relationships between factors of 
production (capital, labor, arid techriology) and changes in national income. 
Hodils are, also, used to predict changes in world population, food 
production, industrial growth* and pollution levels. Many contemporary 
discussions surrounding the policy issue of "limited growth" are based 
on results of model I1rig forecasting. The main advaritages of model li rig 
forecastirig are its explicitriess arid capacity to describe complex and 
dynamic social processes. Its disadvantages iriclude a high level of 
abstractiori, mathematical terms which are Uriiritell igible to many policy- 
makers, and a lack of reliable and valid information to test predictions . 
derived from models. Nevertheless, modelling forecasting has great potential 
in capturing the complexity, dynamics, and irregularities of policy environments 

Normative forecasting is similar to rnddelling forecastirig iri its 
emphasis on the coristruction and use Of formal mathematical representations. 
In normative forecasting, however, the variables of interest are directly 
connected with public policies and policy actors. The objective of 
normative forecasting is to optimize resource allocations, given certain 
nomative (i.e., value) criteria. For example, nonnative forecasting may 
include efforts to predict optimal combinations of time, manpower, and 
financial expenditures as part of an overall effort to analyze and re- 
cbnmind appropriate policies. Normative forecasting may involve efforts 
to forecast optimal allocations of teaching time, research and development 
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allocationSi and public investmerits in flood control arid irrigation pfdjects. 
Normative forecasting uses a variety of techniques (e.g., decision networks, 
linear programming j to predict the most efficient choices possible urider 
different conditions. The advantages of normative forecasting include 
explicltness, standardized methods, and ah action-orientation. Disad- 
vantages include the high level of abstraction of models, the lack of 
reliable and valid information, and the requirement that policies be adopted 
before predictions may be tested. In short * the key assumption of arty 
hdrmative forecast is that recdmnehdatiohs will actually be implemented. 

Analogy fxDrt^asti^ makes estimates of probable future states oh the 
basis of theoretical assumptions about similarities between policy systems 
and physical and human organisms. Analogy forecasting is perhaps the oldest 
of all approaches, insofar as policy systems such as nations are likened 
to individual htinah actdrs--e.g. , the nation is viewed essentially as an 
individual "actor'* who makes rational choices. Analogy forecasting is also 
based on assumptions about similarities between policy systems and biological 
drganisms. For example, biological growth (S-shaped) curves are used to 
predict changes in the growth of public drgahi zations . Analogy forecasting 
also sometimes draws on general systems theory— i.e., that branch of science 
which deals with the study of physical, biological^ arid human phenomena as 
"systems" of iriterdependent elements. Historical ahaldgies— e.g. , the fall 
of the Roman Empire— are also used as a basis for forecasts. The main 
advaritages of arialogy forecasting are its explicithess and, capacity to 
raise interesting questions about parallels betweeri policy processes arid 
other kinds of activities; its major weakness is that ahaldgies do not permit 
firm conclusidhs about the relevance of similar situations or "systems" for 
predicting chariges iri the content of policies or the behavior df pdlicy 
actors. Analogy forecasting is often advocated as ari "heuristic" device-- 
i.e., one which assists in discQvep4ffli bases for prediction rather than 
justifying them on scientific grounds. 

Extrapolative forecasting, already discussed above, is not derived 
from any particular theoretical perspective* but rather depends on assump- 
tions about the coritiriuity of past and future events. While advantages 
and disadvantages have been reviewed in the preceedirig sectiori, it is im- 
portant to emphasize that extrapolation may be applied td linear relationships 
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(e;g;, secular trends) as well as nori-lineai^ ones (e.g;, cycles, fluctuations* 
irregularities). As policy environments become more dynamic, complex, and 
irregular the success of extrapolative forecasting also decreases sub- 
stantially. Extrapolation has the advahtagis of expl icitness, standardized 
methods, and a primary reliance on experience acquired through the systanatic 
monitoring of policy environments. Its principal disadvantage is the fact 
that forecasts are based on assumptions, rather than theories which actually 
explain why changes occur. 

Survey forecasting uses questionnaires and interviews administered 
to samples of a population in order to project changes in attitudes, opinions, 
or values of different segments of a conmunity. Survey forecasting may use 
panels of individuals (i.e., the same persons) who are interviewed over 
successive periods of time. For example, a survey forecast may follow a 
group of high school students through a period Of twenty years, attempting 
to monitor and then forecast changes in attitudes toward government. In 
contrast, survey forecasts may use cohorts— i.e. . different individuals 
from the same age group are interviewed over successivi periods of time. 
For example, three groups of high school students of the same age (12-16 
years) may be interviewed at three successive points in time (I960, 1970, 
1980), on the assumption that Changes in attitudes among students with the 
same characteristics (but who are not the same person) may. serve as a good 
predictor of the future. Survey forecasting is useful for estimating trends 
in value profiles, political beliefs, and assessments of public needs. 
Surveys have the advantagi of expl icitness, standardized methods, and a 
reliance on experience acquired through systanatic monitoring, its main 
disadvantage lies in the fact that attitudes, values, and opinions are 
often highly unstable, thus making it difficult to obtain reliable and 
valid information. Many surveys also suffer from the same weaknesses as 
the extrapolation of trends through time series analysis-i.e. , surveys 
are typically based on assumptions of historical continuity, rather than 
theory. 

Clinical forecasting seeks to make predictions about policy actors 
on the basis of information about their attitudes, motivation, and past 
behavior. Gn6 of the main objectives of clinical foricasting is to assess 
the probable future behavior of policymakers and organizations by Jdentifying 
past patterns of political influence or "leverage," degrees of .commitment 
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to certain courses of action, and the scope of resources available to 
different pol iey actors. A ritinibeif of efforts to develop frameworks for the 
study of policy-making elites--i,e. , persons who regularly make and in- 
fluence key decisions— have served as a basis for clinical forecasts (see 
Bauer and Gergen, 1968). Clinical forecasting is typically non-quantitative 
arid lacks the degree of explicitness of other approaches. Nevertheless, 
it places primary reliance on experience acquired through monitoring policy- 
making behavior; it is more directly oriented to concrete policy processes; 
arid it places heavy onphasis ori questioris of political feasibility. Clinical 
forecasting, while less successful than other approaches iri makirig reliable 
predictions, also rests on assumptions of continuity be1»«een past arid 
future actions. Like other approaches to forecasting it therefore runs the 
risk of conservative biases, even though it advocates claim that it is 
more "realistic" than other approaches. 



7. The F.B.i.'s bniform_ertme Reports indicate that total crimes 
against person increased by 169 percent in the period 1960-1972. 
If you were to estimate from this data the growth of crime in 
the period 1973-2QD0, what would the basis of this forecast 
be? What is the object? 



8. Provide on the basis of your own experience an example of each 
of the twelve types of forecasting discussed iri the unit 



narrative. 
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9. Provide descriptions by means of naturalistic monistic, and 
intrinsic methods of the "energy crisis" as a policy problem, 
then indicate what kinds of forecasts are likely to result 
from each myth. 
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FOREeASTlNS: STRENeTHS AND LIMITATIONS 



Forecasting in some fom is essential for rational choice; Only 
by having knowledge of the probable consequences of actions is it possible 
to exercise choice; if the consequences of actions are completely urifcnowri 
or random it is unlikely that any actions will be taken at all. Although 
some pblicymakihg behavior is habitual, routine, and highly "rationalized", 
many major decisions are made on the basis of explicit forecasts of probable 
consequences. Nevertheless, it is obvious from our review of mador ap- 
proaches to forecasting that efforts to' predict changes in policy environ- 
ments,, the content of public policies, and the behavior of policy actors 
suffer from several limitations: 

1. Jrregu^a^^jty, Forecasts are likely to be most 
successful when objects of prediction are regular, 
sustained, and continuous. Since many of the most 
important changes in policy ehvirohments, policies, 
and behavior are irregular, interrupted, and dis- 
continuous, only the most complex of approaches 
(e.g., modelling forecasting) are likely to produce 
reliable estimates of future trends. Some of the 
most simple approaches (e.g., intuitive, extrapolative, 
and horablogical forecasting) may not be_ appropriate 

or Well-suited for highly complex social processes. 

2. Time . Forecasts dealing With short-term changes in 
complex and unstable social processes (e.g.* changes 
in value profiles) are likely to be more successful 
than those Which seek to predict Ibhg-terni changes. 
Nevertheless, many of the most complex and critical 
policy problems (e.g., ecological degradation and 
pollution) require Idrig-term forecasts to the end of 
this century and beyond. 

3. I nadequate Inf ormat ion . Forecasts which cannot be 
made with reliable and valid information acquired 

through systematic monitoring must place great 

reliance dri irituitidri, including hunches, educated 
guesseSi and speculation. Since reliableandval id _ 
irifdnflatidn is lacking in many_issues-areas~e.g. , it 
is difficult at present to detennine which educati^ 
social and environmental policies work best and why- 
there is a tendency toward the heavy use of approaches 
that are least dependent on goodjnformation (e*g.* 
intuitive and nomological forecasting). The ultimate 
test of any forecast isexperience. intuitive and 
"ridmdldgical approachescan easily become sources of^ 
authoritarianism, insofar as they rely oh the special 
personal qualities of ..experts, religious leaders, or 
gurus. 
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4. Methodism , Forecasts which rely heavily dri m^^ 
but do not pay sufficient attention to experience 
(e.g. > model 1 ihg and nonnattve_f^ tend 
strongly to create inusloris of '^scientific" validity 
when there is actually little or no reliable infor- 
mation on which to base forecasts. This often results 
in an exaggerated concern with methgds (''methddism" 
formal scientific rules ("scientism" and quantitative 
techniques ("quantophrenia" )• 

5. CoBsarya^gn. Forecasts which rely heavily on experience 
may have a tendency toward conservative biases, since 
thefuture is assumed to be a direct continuation of 
past conditions, policies, and behayiors._ Approaches 
based on theory (e.g» » theoretical and nomoTqgical • 
forecasting) sometimes represent policy sys tans as _ 

if they wereuniversallystable, regular^ or invariant 
(e.g. , the theory of "disjointed incremental ism"). Ap- 
prqachestesed onextrapolation je.g^, extrapqlative and 
survey forecasting) also tend qften_to represent policy 
systems in the same vsay, thus suggesting^t^^ or 
perhaps unrecognized alternatives are impossible. 



6. Lack of Gontrols^. Forecasts which are primarily 
oriented toward changes in policy enyiroranents(e.g;, 
crime rates, drug addicidh^ welfare rolls, iriccfmejdis- : 
tribution) are often unrelated to actual policy alternatives, 
since it is difficult to relate broad social changes (e.g. , 
increases in crimes against property) to gbvernment action 

. or inaction {e.g. , law enforcement training programs) un- 
less one monitors and forecasts environtnents^ policies, and 
the behavior of policy actors at the same time. Eifoad 
social changes such as those measured by the growth of 
crime may be due to factors (e.g.* family structure) 
beyond the control of policy makers. 

7. Indefinite Impact s Forecasts which are primarily 

. drlented toward changes in the content of public _ 
policies (intuitive planning, theoretical planning, 
hormat iye forecasting ) and the behayipr of pql icy 
actors (analogy and clinical forecasting) are often 
unrelated to policy impacts--] .e. , they fail tqshqw^ 
how policies actually change policy environments which 
are complex, unstable, and irregular. _A variety of 
techniques associated with normative fqrecastjng^^ln- 
cluding decision trees, linear programning, and cost- 
benefit analysis— sometimes produce elegant quantitative 
"solutions" which turn qut_ to have solved the wrong 
problem, as in urban renewal programs designed for the 
poor which result in their migration from the area 
"deve-loped" by planners. 
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Op to this point we have cbrisidered limitations of ^jagle approaches 
to forecasting. Fortunately* we are not compelled to accept either one 
or the other of the. several approaches as the only valid vray to forecast 
changes in policy systems, a procedure which would only result in dog- 
matism arid failure. Iri this context, one of the most promising ap- 
proaches is muTtimethod-forecast4nq^ , which seeks to estimate future changes 
in several objects (environments, policies, policy actors) by using 
multiple bases (intuition, theory, extrapolation). Multimethod fore- 
casting may be applied according to one or all of the followirig pro- 
cedures: (1) by employing multiple modes of inquiry (logico-deductive, 
inductive^ dialectical) to define a forecasting problem; (2) by applying 
multiple approaches (e.g., intuitive, normative, and clinical fore- 
casting) to the same policy problem; arid (3) by applying different ap- 
proaches to different aspects of policy systems. The last approach to 
multimethod forecasting is raost prevalent, although the reasons for 
selecting a particular approach are seldom made explicit. The choice 
of approaches seems to be guided by habit, ideological persuasion, or 
purely practical consideratioris. Iri Harrison's words (1976:9-10): 

[Ejliriical forecasting procedures are used to estimate 
the probable action^ of key decision makers...; extra- 
polative and arialogy forecasting methods are used to _ 
estimate the demographic characteristics of the social 
fabric; survey foreeastirig .techriiques. are used to 
estimate trerids in values iri social classes^ age groups ^ 
or other birbad social categories; gravity models [i.e.^ 
modelling forecastirig] are used to forecast trarispdrtation 
patterns or populatibri migratibri patterns; and so forth. 
A total social forecast covering avariety of topic areas 
could therefore* employ a variety of methods. 

in summary, policy arialysts must know which courses of action (policy 
alternatives) are likely to resolve policy problems. The policy-analytic 
procedure of forecasting prbvides irifbrmatibri dri the cdrisequences of different 
policy alternatives. The approaches to forecasting discussed above may be 
compared and coritrasted according to their primary basis and object. Each 
approach has characteristic strengths and limitations, depending upon the 
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nature of the social processes which policy analysts seek to forecast. 
Many of the limitations inherent In particular approaches may be overcome 
by CTploying nwltlraethod forecasting^ even though the choice of forecasting 
methods seems now to be guided more by cohvehlence or habit than by 
systematic considerations of methodological apprdprlatehess. While there 
is no doubt about the sighificahce of forecasting for policy analysis, 
results have so far been mixed. In any case* forecasting policy 
alternatives is only part of the challenge facing policy analysts; policy 
analysts must also recomnend policy alternatives according to some scale 
of values, which Is the subject of the next unit. 



10. When is intuition most useful as a basis of forecasting? 



11. What kinds of social processes are most suitable for approaches 
to forecasting based on extrapolation? 



12. Rank different approaches to forecasting according to their 
reliance on authority, methods, and experience. 
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SELF-TESTING EXERCISE 

All forecasting approaches permit us to make cause and effect statements 
aBout the future. 

(a) True • 

(b) False 

A straight line trend is most useful for projecting future changes in 
social processes which are: 

(a) discontinuous 

(b) irregular 

(c) stable 

(d) random 

An intuitive forecast is most aipprbpriate under which one of the following 
conditions: 

(a) no data on policy outcomes is available 

(b) past trends are irregular 
(cj past trends are cyclical 

; (d) past trends are secular 

A multimethod forecast is probably most appropriate for problems which 
are: 

(a ) wel 1 -structured 

(b) simply structured 

(c) ill -structured 

An approach toforecastingwhos^ primary methodological basis and 
object are theory and the policy environment, respectively, is: 

(a) nomological forecasting 

(b) analogy forecasting 

(c) clinical forecasting 

(d) theoretical fdnecasting 
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6. A conservative bias is most Hkely to be found aiwng policy analysts 
who employ: 

(a) intuitive forecasting 

(b) analogy forecasting 

(c) nomological forecasting 

(d) survey forecasting 

7. Which one of the following approaches to forecasting would you employ 
to project changes in population between 1977 and 2000? 

(a) intuitive forecasting 

(b) theoretical forecasting 

(c) clinical forecasting 

(d) 6xtrap61ative forecasting 

8. Survey Forecasting is typically used to project: 

(a) changes in value profiles 

(b) changes in industrial growth rates 

(c) changes in the content of policies 

(d) changes in government expenditures 

9. Forecasts which manifest an exaggerated concern with methods are often 
described as . 

10. The success of different approaches to forecasting depends on: 

(a) the length of the time interval selected 

(b) the nature of social processes 

(c) the reliability of information 

(d) the personal qualities of persons making forecasts 

(e) all of the above 

(f) none of the above 
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ASSIGNMENTS 

i. Listed Below are_ statements about different jjdlicy dutcdmes. Beside 
each statement list the most appropriate approach for forecasting 
policy alternatives. Use the following symbols: 



IF 




Intuitive Forecasting 


IP 




Intuitive Planning 


NMF 




Nomo logical Forecasting 


TP 




theoretical Forecasting 


MF 




Modelling Forecasting 


TP 




Theoretical Planning 


NRF 




Normative Forecasting 


AF 




Analogy Forecasting 


EF 




Extrapolative Forecasting 


SF 




Survey Forecasting 


GF 




Clinical Forecasting 



Rates. df: inflation recorded in the past year are a function 

of relatidns between several factors: wages, employment, and 
the supply df money in the economy. 

^Population has increased at a steady but declining rate in the 

past decade. 

^Citlzens are increasingly dissatisfied with the quality of 

municipal services. 

Available information does hot permit firm conclusions about 

the growth of agency caseloads. 

A vailable information does not permit firm conclusions about 

who benefits from social programs. 

- — C hanges in the occupational structure show that expert knowledge 
is increasingly valued in a society which is becoming more and 
more complex. 

^-T he more scientific elites are involved in policy formation, 

the less democratic the society. 

4^ ublic works project A costs more than project B, but results 

in more jobs for the dollar. 

T he agency director is heavily conSitted to the reorganization, 
but exercises little influence on such decisions. 

N ations which participated in the conference recognized their 
common interest in survival and considered unilateraldisarmament 
for the first time. 
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2. The table below lists several issue-areas. Across from each issue- 
area provide an illustration of forecasts based on intuition, theory* 
and extrapolation. Study Table 4-1 in the unit narrative before you 
begin. 



TABLE 4-4 

Bases iif^ Forec a st s in Three I s s u e-Are a s 





Basis of Forecast 


Issue-Area 


Intuition 


Theory 


Extrapolation 


Health 








Education 








taxation and 
Revenue 









3. Study Table 4-5 below, which shows the growth of Gross National Product 
and energy danand from 1950 to 1970.^ Note that 6NP as a measure of 
national income is strongly and pa^t4v^4y correlated with energy demand, 
measured in quadril l ion BTUs jBritisii Thermal Un Hence, the demand 

for energy is dependent for the most part upon the size and grwoth of 
the economy. 
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TABLE 4-5 

U.S. Gross National Prbdijet arid Energy 
!^^ye-Year Intervals. 1950-1970 



Year 


Gross National Prbduet 
(billions constant dollars) 


Energy Betna rid 
(quadrillion BTUs) 


1 

1950 


355.3 


29.7 


1955 


438.0 


34.3 


1960 


487.7 


38.2 


1965 


617.8 


45.3 


1970 


720.0 


56.0 



SOURCE: Adapted from B. Hughesj U.S. En$rgy»_Evn1rdnment and 
Economic Problems: A PuBlic^Pglicy Simulation ^_ 
(Chicago: American Political Science Associations 1975) * 
Table 5, 24. 



Use the data in Table, 4-5 to: (1) draw a straight trend line which 
shows the growth of GNP from 19^^ the trend with a |aWd 

linej; {2) draw another straight trend line which extrapolates tne 
growth of GNP to Show the trend with a broken line whose shape 

you estimate v^tsua^l ly— i . e, , do not attanpt to calculate rates of 
change mathematical ly. 
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GNP 



1400 

1300 
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1 



I J J 



T 



• 1950 1955 1960 1965 1970 1975 1980 1985 1990 

(a) Do you think that the trend in the growth of SNP shown by 
your trend lines is a realistic estimate of future economic 
conditions? Why or why not? 



(b) Is a continuation of the projected trend desirable? Why or 
why not? 



(cj Do you think that energy demand between 1970 and 1990 will follow 
the same pattern as that evidenced in the 1950-1970 period? 
Why or why not? 



(d) SfiP in 1970 was $720 billion. If precise mathenatical pro- 
jections show that it will grow at a rate of 3.5 percent per annum 
what will SNP be in 1990? To make this calculation multiply the 
base year figure {1970=$72O billion) by the annual rate of growth 
(3.5- percent, or .035); then add the product ($720 x .035 » $25.2) 
to the base year ($720 + $25.2 = $745.2). This gives you the pro- 
jected estimate of SNP for 1971. Jlepeat the procedure for each 
year until 1990. What is your esjglgge of GNP in 1990? 
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(e) Now go back and place an X at the point on the graph where 
the year 1990 and your estimate of GNP intersect (i^e. i where 
a line drawn horizontally from estimated GNP crosses the 
vertical line for 1990). How does your arithmetic^ estimate 
of GNP compare with the trend line you estimated visually? 
How large is the difference, measured in billions of dollars? 



(f) What are the advantages of extrapolations calculated with 
mathematical procedures, as compared with visual estimates, 
hunches, and educated guesses? What are the possible dis- 
advantages of using such precise procedures? (Hint: Recall 
the assumptions of extrapolation) 

Study Table 4.6 on the next page. This table gives projections of 
Gross National Product, energy demand, air pollutants, and rates of 
unemployment for two sets of policies^ One policy (standard growth) , 
which reflects hi stbricali growth patterns in this century, involves 
an average increase of GNP of 3 percent. The other policy (slow 
growth] is consistent with the positions of various advocates of 
"limits to growth" and assumes an average increase of GNP of 1 percent. 
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(e) Now go back and place ah X at thej^lnt bh tfie graphwhere 
the year 1990 and ydurestlmate of GNP intersect (i.e., _where 
a line-drawn horlzdntilly from estimated SNP crosses the 
vertical line for 1990). Bow does your arittinetic estimate 
of GNP compare withthe trend line you estimated visually? 
How large is the difference, measured in billions of dollars? 

(f) What are the advantages of extrapolations calculated with 
mathonatical pjrocedureSi as compared with visual estimates, 
hunches, and educated guesses? 

4. Study Table 4-6 on the next page, this table. gives projections bf_ 
Gross National Product, energy danahdi air pollutants, and rates of 
unemployment for two sets of policies. One policy (standard growth), 
whichreflects historical growth patterns in this century^ involves 
an average increase of GNP of 3 percent. The other policy (slow 
growth) is consistent with the pdsitidhs of various advocates of 
"limited growth" and assumes an average increase of GNP of 1 per- 
cent. 

^ Assume thatexjsting levels of air pollutants (measured_lh millions 
of tons) per unit of energy demand (^^ in quadrillidri BTUs)_will 

rOTain constant under standard or slow growth policies and minimal 
government regulation of industry and consurger behavior (loose controls). 
Now assume that pollutants per unit of energy demand can be reduced 
by 25 per cesit under maximal regulation (strict controls), which will ' 
increase unemployment rates by 1 and 3 percentage points, respectively, under 
standard and slow growth policies. 

(a) Oh the basis of data in Table 4-6 calculate the consequences 
of each of the policies in the year 1990. Mote that the first two rows 
have been completed as an illustration. 



Policy 


GNP 


Energy 
Demand 


Air 
Pollution 


Unemploymerit 
Rate 


Standard Grdwth/ 
boose Controls 


1300.0 


101.6 


26517.6 


5-6% 


Standard Growth/ 
Strict Controls 


1300. d 


101.6 


19888.2 


6-7% 


Slow Growth/ 
Loose Controls 










Slow Growth/ 
Strict Controls 











i • 



TABLE 4-6 

GNP, Energy Bemand and iirJoUatapU 
dird and Slow Growth Poltdes. 1970-1990 



Standard Growth Policy (3.0^) 



Slow Growth Policy (1.03!) 







Energy 


Air 


Uneniplppent 




..Energy 


. .. Air 




year 


GNP,ij 


Demand (2) 


Ponutants[3j 


Ratej4) 


GNP(ij 


Deindndsj2) 


Pol]utantS(3) 




1970 


720.0 


56.0 


14608.0 


5-62 


720.0 


56.0 


14608.0 


8-lOX 


1975 


834.6 


65;2 


17017;2 


5-62 


727.2 


56.8 


14824.8 


8-lOX 


1980 


967.2 


75.6 


19731.6 


5-62 


734.5 


57.4 


14981.4 


8-lOX 


1985 


1121.3 


87.6 


22863; 6 


5-62 


741.8 


57,9 


15033.6 


8-lOX 


1990 


1300.0 


101.6 


26517.6 


5-62 


749.2 


58.5 


15268.5 


8-lOX 



NOTE: W GNP in billions of constant |1958) dollars: 

(2) Energy demand in quadrillion OTUs final demand. 

(3) Air pollutants in millions of tons used for electricity production. 

(4) Unemployment role as registered unemployed as" a percentage of the labor force. 

Estimates based on Hughes (1975). 
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(bj Which of the four policies would you recofiinend? Why would you 
recommend It? 



_ (c) Wbuld you change ypur rec^ 
to coal , reducing the dependence on scarce pi1 reserves and costly im- 
ports and increasing the rate of growth of GNP and jobs? Why? 



-- (d) Would you change your recdnroehdatidhs if a shift to coal pro- 
duced a substantial increase in pdllutibn: in the form of particulates 
(e.g., coal dust), a mar Red increase in Black Lung disease among miners, 
a sizable growth of respiratory disease among children under 5, and many 
additional deaths among people over 60? Why? 



5. AsIc two persons (at work or at home) to speculate or guess about, 
future changes in GNP* energy demand, pollution, and unemployment. 
Specifically* askthem whether there will be a large increase (LI), 
small increase (SI), small decrease (SD), large decrease (LD), or 
no change (NC). Record these Intuitive forecasts below. 
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Intuitive Forecast 



Person 



GNP 



Energ^r 
Demand 



Air 
Pollutants 



Unemployment 
Rate 



A 



B 



How do tfiese intuitive fbi^asts compare with those in Table 4-6? 
Do you have more confidence in the extrapblative forecasts, or the 
intuitive ones? Why? 



Hi 
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ANSWER KEY FOR SELF-TESTING EXERCISE 

1. (b) 2. (c) 3. (a) 4. (c) 5. (a) 6. (d) 7. (d) 8. (a) 
9. Methodism 10. (e) 
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INTRQBUCTION 

Policy aetibris taken within public organizations presuppose rational 
choices among alternative courses of action. While the exist^n^ of 
different types of rationality (technical, economic, legal, social, and 
substantive) raises questions about the meaning of "rational choice," it 
is clear that some type of choice is essential to resolve public problems. 
The assumption of this unit is that the systematic analysis of alternative 
courses of action available to poliey-inafcers can have positive effects on 
the resolution of policy problems. Public policy problems are sufficiently 
complex as to benefit from (1) an explicit statement of the preferences 
of poli comakers; (2) a careful exposition of available policy alternatives 
and (3) a systematic sat of procedures which assist in relating policy 
alternatives to stated preferences (Zeclchauser and Shaefer, 1968:29). The 
systematic analysis of alternatives and preferences facilitates "rational" 
choices, irrespective of the basis of the choice--i.e. , choices may be 
technical, economic, legal, social, or substantive in nature. 

In preceding units we have seen that policy-analytic procedures of 
problem identification, monitoring, forecasting^ evaluations and recom- 
mendation depend upon one another—i.e. , certain policy-analytic procedures 
are prerequisites of others/ the policy-analytic procedure of recommenda- 
tion presupposes problem identification, mdriitoring, forecasting, and 
evaluation. Recommendation involves choicgs among alternative courses 
of action whose consequences have been forecast into the future. Re- 
commehdatibn involves the choice of alternatives which will contribute 
to the resolution of policy problOTS. 

in this unit we shall consider: (1) the nature of policy recommehda- 
tion as a policy-analytic procedure^ including the various forms of 
systematic analysis that are employed to make rational choices; (2) the 
major components of policy recommendation— i .e. ^ objectives* constraints, 
externalities, time, risk and uncertainty; and (3) the strengths and 
limitations of systematic analysis as applied to problems of policy 
recommendation. 
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LEARNING OBJECTIVES 



kfter completing this module you should be able to: 

1. List the sets of key questions that the policy analyst must 
ask and answer. 

2. Define concepts of relative scarcity, opportunity costs, and 
trade-off. 

3. Recognize the uses of indifference curves arid iridiffererice 
maps. 

4. Compare and contrast policy-making in the public arid private 
sectors. 

5. Distinguish specific, collective, and quasi-cbllective goods 
and their relation to public and private policy-making. 

6. List major tasks of policy arialysis arid their relation to 
policy-analytic procedures. 

7. Distinguish betweeri fixed-budget arid fixed -output problans iri 
policy analysi$. 

8. Compare arid cbritrast cost-benefit and cost-effectiveness 
analysis. ^ 

9. Distinguish alternative approaches to the defihitidrt of 
social welfare. 

10. Compare and contrast policy goals arid policy objectives. 

11. List major cdristrairits on the attainment of policy objectives. 

12. Recognize the importance of externalities , time, risk and 
uncertainty iri making policy reconmendations. 

13. Identify the major strengths and weaknessesof systematic 
procedures for making policy reconmendations. 

14. Apply systanatic procedures of policy reconinendation to 
a problem of your choice. 

— - 
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KEY TERMS AND CONCEPTS 





Relative Scarcity 




Willingness to Pay 




Opportunity Costs 




Shadow Pricing 




Trade-Offs 


• 


Social Welfare 




Indifference Gurve 




Pareto Criterion 




Qrdirial Utilitv Fnnrtion 




u 1 d wf 1 uu 1 una 1 ociic r i 


• 


Specific Goods 


• 


Goals 


• 


Gbll active Goods 




Objectives 




Quasi-Collective Goods 




Constraints 


# 


Type I Problem 




Benefit-Cost Ratio 




type II Problem 




Externalities 


• 


Type III Problem 




Net Present Value 




Cost- Effectiveness Analysis 




Social Rate of Discount 




Cost- Benefit Analysis 


m 


Risk 


m 


Net-Efficiency Benefits 


• 


Uncertainty 
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OVERVIEW 



Objectives 


Tasks 


Resources 


Evaluation 


1. List the sets of feey 
questions that the 
policy analyst must 
ask and answer. 


— — ^ ^ 


Unit 
Narrative 




2. Define concepts of 
relative scarcity, 
opportunity costs, 
and trade-off. 


Study Questions 
1.2 


Unit 
Narrative 


Self 


3. Recognize the uses of 
indifference curves 
and indifference 
maps. 


Study Questions 
3,4 


Unit 
Narrative 


Self 


4, Compare and contrast 
policy-making in the 
public and private 
sectors • 


Study Question 
5 


Unit 
Narrative 


oe 1 T 


5. Distinguish specific, 
collective, and 
quasi-col lective 
goods and their rela- 
tion to public and 
private policy-making 


. Study Questions 
6J 


Unit 
Narrative 


self 


6. tist major tasks of 
policy analysis and 
their relation to 
pdl icy-arialytic 
procedures. 


Study Questions 
11,12 


Unit 
Narrative 


Self 


7. Distinguish fixed- 
budget a. ,d. fixed- 
output problems in 
policy analysis. 


Study Question 
13 


_ Unit. _ 
Narrative 


Self 
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dbjecti ves 


tasks 


Resources 


Evaluation 


8. Compare and contrast 
cost-benefit and cost- 
effectiveness anal- 
ysis. 


Study Questions 
8, 9, IQ 


Unit 
Narrative 


Self 


9. Distinguish alterna- 
tive approaches to 
thedefinition of 
social welfare. 


Study Questions 
14, 15 

• 


Unit 
Narrat i ve 


Self 


10. Compare and contrast 
policy goals and 
policy objectives. 


Sutdy Questi bh 
16 


Unit 
Narrative 


Self 


11. List major constraints 
on the attainment of 
policy objectives. 


Study Questions 
17, 18 


Unit 
Narrative 


Self 


12. Recognize the im- 
portance of exter- 
nalities, time, risk 
and uncertainty in 
making policy recom- 
mendations. 


Study Questi bhs 
19. 20, 21 


Unit 
Narrative 


Self 


13. Identify the major 
strengths and weak- 
nesses of systematic 
procedures for 
making policy 
recommendations. 


Study Questions 
22, 23, 24 


Unit 
Narrative 


. Self 


If. write an essay in 
which you apply 
systematic pro- 
cedures of policy 
recommendation to 
a problem of your 
choice. 


umi Mssignment 




oeif and 
Instructor 
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THE NATURE QF PQblCY RECOMMENDATION 

When policy analysts offer reeotiinehclatibris they engage in apparently 
simply logical processes Involving three interrelated components: (1) 
the definition of a problan requiring action; (2) the analysis of 
available courses of action to resolve the problem; and (3) the choice 
of the alternative which results in a preferred outcome, this process 
may be diagranmed as follows (Figure 5-1), where the first alternative 
(A^) yields one outcome (0^); the second alternative (Ag) yields another 
outcome (Og); and (0^) is greater than Og on some scale of values. Having 
this information the policy analyst will find no difficulty in choosing 
Aj as the preferred alternative. 

A2 = 02 

di > O2 

. • . choose A]_ 
FIGURE 5-1 
A- Simple Model of Choice 

In the world of the practicing policy analyst problens of choice are 
far mbri complex, the public policy analyst must ask and provide answers 
to six sets of questions which go far beyond our simple model of choice: 

1. QbLiictives . What is wanted?: How can objectives (ends) 
be defined explicitly? How are objectives to be measured 
and perhaps quantified? 

2. Costs. What does it cost to attain a given objective? 
How are costs to be measured and perhaps quantified in 
order to compare them with benefits? What other ob- 
jectives most be foregone because of the price paid 

to attain a given objective? 

3. Con straints . What factors constrain or limit the 
attainment of bbjectives? What alternatives mast be 
ruled out because of these constraints? Are such 
constraints as budget size, legal requirements, and 
bureaucratic opposition fixed or variable? 
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4. External i ties . What side effects or spillover effects _ 
will result from the attainment of objectives? Are_side 
effects positive* riegativei or both? Are externalities 
which have not beeniricluded in the analysis of costs, 
arid benefits sufficiently important to modify the choice 
of alternatives? 

5. Time , Will all consequences of choice occur immediately? 
Will some consequences be spread out into the future? 
Will the value of benefits and costs change over time? 

6. Risk and Uncertainty . How certain isit that predicted 
outcomes will actually occur? , How much risk is involved 
in choosing a particular alternative? 

The above questions reflect the complex nature of policy recdnrieridation. 
They also point to the importance of the principle of relative- sea r c i ty - - 
i.e., resources required to attain one objective can always be used to 
attain some competing objective-' Because it is not possible to attain 
all objectives simultaneously, it is necessary to select some objectives 
arid forego others. Almost every choice has its gfipontUR^ity costs— i.e. , 
the amount which it costs as to forego a particular objective (e.g., a cure 
for cancer) by investing in the attainment of some other desired objective 
(e.g., better schools). In most situations jnvotving problems of choice 
it is not possible to proceed on the ctssumption that the attainment of 
objectives is cost-free. Iri fact* many of the most important policy 
problems required self-conscious trid^-offs between competing objectives-- 
i.e., choices which involve the attainment of one objective at the expense 
of another. 

In Figure 5-2 below the idea of trade-offs is illustrated with re- 
ference to highway maintenance and^ healthrcare in three hypothetical 
communities. Highway maintenance (expressed as urtits of highways paved) 
is measured dri the vertical axis. The horizontal axis measures health 
care in terms of units of service.* Point A iri Commuriity II marks an 
output of paved highv^ys of 8.0 units and an output of health services 
of 4.0 units, eurve II-II is called ari indifference curve^ , which is a 
graphical representation of a policy analyst's ordinal utility furiction-- 
i.e., a summary of the policy analyst's preferences for one objective in 



*Note that the scales used to measure highway_maintenance and health 
care are arbitrary and based on fictitious data. They are designed for 
illustrative purposes only. - 2^2 

X.5.7 



PUBLIC POLICY ANALYSIS 



relation to the other. Each of the three curves oh the map (called ah 
Indifference map) represehts a different level of ordinal utility. For 
example, as we move toward the northeast (upper right) on the ihdifference 
map* We find higher levels of ordinal utility— i.e. , curve I-I produces 
more units of health care and paved highveys than curve 11-11^ which 
produces more than curve III-III. 

Betweeh ahy two points on the same indifference curve (e.g., between 
A and B) the policy analyst is "indifferent"'--i .e. , equally satisfied* 
given that (s)he is willing to trade highway maintenance for healthcare. 
The negative ^lope of the curves shows that the policy analyst is willing 
to give up highway maihtehahce in order to achieve more health care, and 
vice versa. The steepne s s of the curves shows that the policy analyst is 



willing to engage in trade-offs between the two objectives. The steeper 
the curves the greater the amount of highwiy maintenance will be sacrificed 
for one additional unit of health care. At point A in CdninUhity II more 
highway maintenance will be traded for ah additional unit of health care 
than at point B. Northeasterly movements across the indifference map 
are always desirable, since they result in cbhtihually higher levels of 
utility. Thus, policymakers would prefer any combination of outputs re- 
presented by different points along curve II to any combination represented 
along curves II-II and Ill-ril. 
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Units of 
Highways 
Paved 



FIGURE 5-2 

trade-offS- -Between Highway 
Maintenance and Health Care 
In Three Hypothetical Cornrnunitiis 

SOURCE: Fictitious data 

In the above example a policy analyst might be required to make re- 
comnendations among one of four alternative inves-bnent projects— i.e. , A, 
B, C, and two of Which (A arid B) are in the same commtJriity. The policy 
analyst should recomnend project C, since it results in greater overall 
utility^ project D is clearly least desirable. Note that it is riot possible 
to make a choice between projects A and B, since the policy analyst is 
"iridiffererit" to various cdmbiriatioris of highway mainteriartce arid health 
care between the two points on curve Il-il. Note also that the policy 
analyst would not be iridiffererit to poirits above or below poirits A arid 
B on curve n-.n, since these poirits represent the limits to which (s)he 
will go in making trade-offs. . 
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The concept of trade-offs is particularly important in puBlic policy 
analysis, since one of the essential differences between public and private 
pdl icyniaking is the existence of group conflict among multiple policy 
actors in the public sector. There are at least three essential differences 
between public arid private policy-making (Hiririchs and Taylor, 1972:4-5): 

1* the Nature of Public Policy Processes . Policy formation 
iri the public sector is a group process involving bar- 
gaining iCdmprdmise* arid coriflict ambrig citizens V groups, 
legislative bodies, executive departments, and business 
firms, there is no single producer or consumer of goods 
whose profit or welfare is to be maximizedt The presence 
of multiple pql icy actors makes probloitls of public choice 
far more complex than in the private sector. 



2. The Nature of Public Policy Goals . Public Policy goals 
are generated from group processes. They are therefore 
more complex, dynamic^ and difficult to define than 
those in the private sector. Group goals may require 
some attempt to calculate "net" benefits and costs among 
various members (e.g. , the satisfaction of the majority 
minus the dissatisfaction of the minority). When agroup 
makes decisions some members may gain or lose more than 
others. In some cases, pne_ person ' sga iri is another's 
loss, thus creating a situation of conflict which is 

not easily resolved. 

3. The Na ture of-PuEl4c-SoQd^. Public andprjvate goods 
• may be classified into three groups: specific noods^ 

collective goods, and quasi^collective goods. Specific 
qoo4s are finjte_and_exhaustible. They are al so exclusive, 
in the serise that the person who owns the goods possesses 
legalrjghts to exclude others from their benefits. 
The consumption of such specific goods as automobiles, 
electrical appliances, and industrial machiriery is limited 
to one person at a time (including legal persons, such as 
corporations). The allocation of specific goods can be 
made on the basis of market prices, as determined by 
supply and danarid. Collective goods may be consumed . 
by everyone; no^ person is excluded from the "consumptiori" 
of erivirormerital protection, social security^ arid public 
health. The allocation of collective goods cannot be made 
according to market prices, since "laws'* of supply and de^ 
marid are not operative, (jua s i -co TTective^ goods are specific 
goods whose production. has significant collective spillover 
effects for society. Although goods such as elemeritary 
education* police protection * and health care might be 
produced exclusively within the private sector, the 
"externalities" associated with their production are 
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deOTed sufficiently important to society to justify 
public programs which provide a greater quantity at 
a lower price. 

Organizations in the public and private sector^ produce each of the 
three types of goods. Nevertheless, the public sector is primarily 
occupied with the provision of collective and quasi-collective goods 
such as defense, education, social welfare, transportation, public 
safety, ehvirdhmerital protection, recreation, arid eriergy conservation. 
By contrast, the private sector is primarily concerned with the pro- 
duction of specific goods (Figure 5.3),' the nature of such goods differs 
arid so do the procedures for their pricirig and optimal allocation iri 
society. The price of environmental protection or public health can- 
not be determined in the same way as the price of ari electric tooth- 
brush or hair dryer; nor are societies willing to leave the allocation 
of education, health, and social welfare to decisions in the marketplace. 




FIGURE 5-3 

Three Types of Goods in the Public xtnd-Rrivate^ Sectors 
SOURCE: Hinrichs and Taylor (1972:5) 
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In dealing with problems of trade-offs between competing objectives, 
public policy analysts seek to use scarce means to attain virtually 
limitless ends, in order to link ends (objectives) and means (alternatives) 
public policy analysts must accomplish several tasks: 

1. The cmiversion of va^l^s into specific objectives , usually 
by operationally defining and measuring preferred policy 
outcomes « 

2. The specification of the target populatidn which is to 
be the recipient of benefits associated with policy 
outcomes « 

3. The col T ection of i^if orina t i eg on the costs arid con- 
sequences of each alternative course of action. Iri^ 
formation used for moriitdring arid forecasting may be 
gathered from a variety of sources--mariagemerit irifor- 
mation systems, pilot studieSiexperimerttSi surveys, 
previous policies, reports, and informed judgment. 

4. The specification of alternative courses action 
available to achieve objectives* including the re- 
cognition of constraints to their achievement— 
e.g.* political opposition i legal limitations, 
technical know-how, budgetary leyel s. Inaction 
should also be regarded as an alternative. 

5. the assessment of costs and consequences of different 
courses of action, including the analysis of different 
Lo/;efits or outputs which will accrue to target 
p^^pijlations, as well as significant external ities- 
i.c, positive and negative side effects and spill 



overs. 



6. The C0fflpar4^on-&f -alternatives in terms of their 
probable costs and rr?nefits, including trade-offs 
between different ca; in'nations of alternatives; 

7. The yec ^^ endatjon of^M-Q^ro ore i^gref^ 
includi^ i the preparatijn of a "briefing package," 
*staff per, "_or_"execj^tive summary*' for those 
v;ho wi^" ^Mrticjpate in a:aking a final decision 

id ensj::;:^! in policy act-ions. 

:> ,/enc"* ^< which policy ^r., lysts actually aeebmplish these 
trt^L- vn' I : . y -n practice--in sere cases the collection of information 

pf Ked : . tasks, while in other cases the specification of a 
target j^Jpui ^-r.vrn wi'il be accomplished prior to the definition of objectives, 
In Figure b^lc^^ these various tasks have been related to the five 
poi icy-analjy'tic procedures d -^cussed thus far in preceding units. 
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In accomplishing the set of tasks discussed above policy analysts 
must contend with three kinds of problems surrounding the costs of 
alternative courses of action. (1) In problem type I policy analysts 
are confronted with a fixed- budgei , which makes it necessary to maximize 
benefits within the limits of available resources- Foi- example, given a 
budget of $1 million the health policy analyst will seek to find the 
optimum mix of health care delivery vehicles to Improve various health 
indices in the conmunity (e.g,, morbidity rates, live births, disability 
days averted). (2) In problan type II policy analysts are confronted 
with fixad-Q^tputs , which makes " <^ary to minimise costs to achieve 
a specified level of outputs or For example, given a specified 

level of municipal transportat^o -.^ che problem is to find the 

least cost "mix'' of bus, monr^ r .oway tra-^'^portation. (3) In 

problem type ill neither costs no'- efits a>^ f'xcJ — i.e., po'ncy analysts 
are confronted with variable budgets-^ na -wtputs . For example, the President' 
. choice of an optifnal budget and preferred government outputs is a type III 
problem. A thorough and competent analysis may often require approaching 
problems in terms of variable budgets (costs) and outputs (benefits). Here 
the policy analyst may attempt to determine the effects of small or in- 
cranental changes in budgetary levels on outputs, and vice versa. 

In each of the these problems it is necessary to compare costs and 
outputs in a systematic manner. There are several different techniques 
esnplbyed by policy analysts for this purpose, tv« of which are described 
below: 

1. Cait:-^ffectiveness Analysis . Pol icy analysts attempt to 
determine the costs of each alternative in achieving a 
fixed or equal outcome ( equal -effectiveness analysis ). 
By contrast, analysts may attempt to detemine the out- 
comes of each alternative, given a fixed or equal cost 
( e^ual-cost analysis ). 



2. Cost^Benef 4t-Analysi s . Policy analysts attempt to de- 
termine the benefits to society of expenditures on each 
of several alternatives. Gost-beriefit analysis may be 
used for fixed -budget and fixed output problems. The 
essential difference between cost-effectiveness and 
cost-benefit analysis lies in the ways that outcomes 
are measured^-cost-behef i t arialysi s measures outcomes 
(benefits) in monetary terms , whereas cost-effectiveness 
analysis does not. For example, a cost-effectiveness 
analysis of manpower training programs would seek to 
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i. Define objeictlves 



2. Specify Population 



Problem 
Identification 



+ 

4^ 







3. Collect Information 










4- Specify Alternatives 







Monitoring 




+ 
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Forecasting 



5. Assess Costs and 
Consequences 



Recomrtiehdation 




7. Recorrinerid Alternatives 



Evaluation 



FIGURE 5-4 



Tasics-4a-Po1-icy Analysis Related 
To Pol icy Analytic P^rocedures 
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determtriej the pereentreductidh in uriemplqyment for 
every dollar spent i By contrast ^ a cost-benefit 
analysis would attempt. to estimate how much income 
Would be earned by newly employed graduates of the 
program for every dollar spent. 

A basic difficulty in comparing costs and benefits is using the 
same system of values. Valid comparisons of costs and benefits require 
that inputs and outputs be assigned values in the same unit of measurement* 
While monetary values would appear to provide a solution to this fDroblem, 
certain basic differences between the private and public sectors make 
monetary valaes a poor or inadequate yardstick. 



Much difficulty in public decisions occurs because many 
of the outputs and inputs of public undertaking accrue 
to and are contributed by a number of entities^ not 
just one as in the ease of parsbnal or business de- 
cisions. When a businessman contemplates an investment 
decision, he worries only about the revenues which the 
investment will bring into his firm. . .The public de- 
eisiorimaker^ on the other harid^ must be concerned with 
the values placed oh the program's outputs by each of 
the recipients of the output gf the public program 
and with the value of the costs incurred by each 
citizen who is forced to sacrifice something to support 
the undertaking (Rinrichs and Taylor, 1972:9). 

Cost-benefit analysis is the technique most frequently used to 
evaluate public programs. In a cost-benefit analysis the analyst often 
attempts to use monetary values to determine the net-^fje4ency benefits 
of a program, defined as gross benefits minus gross costs. Gross benefits 
are measured in terms of the total wilTi4^gnes^^to- pay of all persons who 
prefer to have the program. Costs are measured by the monetary value of 
goods and services devoted to the program. In measuring net efficiency 
benefits analysis sometimes use the market value (i.e.^ current selling price) 
of the goods produced and consumed in a program as the basis for valuing 
costs and benefits. Nevertheless, the use of market value as a yard- . 
stick will not provide a valid measure of costs and benefits unless several 
conditions are satisfied (Zeckhauser and Shaefer* 1968:69): (1) There 
are no externalities (i.e., significant side or spillover effects) 
associated with the consumption of any good or service produced by a 
public program; (2) the size of the program is not sufficiently great 
as to alter significantly the prices of goods produced; and (3) all 
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benefits produced and all resources used have prices which have been 
established through the free interplay of supply and demand on the mar- 



For a variety of reasons many public programs fail to satisfy one or 
more of the above cdriditibris. For example, manpower training programs 
of sufficient size may produce large numbers of newly employed workers; 
at the same. time new employment creates additional income, higher con- 
sumption, lower crime rates, etc., making it extremely difficult to 
estimate the "market value" of the social benefits derived from the 
program. Because market prices are inadequate measures of net social 
benefits, policy analysts often use shadow pricing to estimate benefits— 
i.e.i procedures Whereby analysts adjust faulty or distorted market prices 
by making subjective estimates of the real but unknown value of public 
goods. Shadow pricing may be used in cases where goods are transferred 
from one government agency to another (internal transfer pricing); where 
mdndpdlistic pricing practices exist; and where government taxes, re- 
gulations, or subsidies distort market prices such that changes in supply 
and demand do riot reflect the present or future prices of goods produced 
by a government program. Perhaps the best example of the need for shadow 
pricing .cdmes from the issue-area of environmental policy: What is the 
market price of clean air and pure water? How can we calculate the social 
benefits of environmental protection in monetary terms? 
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STUDY QUESTIONS 

1, How many public policy goals 1n areas of health* welfare* labdri 
defense, and education do not involve trade-offs between competing 
objectives? Illustrate your response- 



2. How would you go about calculating the opportunity costs of sending 
a man to the moon? 



3. What would be the implications of a positively sloped indifference 
curve? [ Hint : Think in terms of trade-offs] 



4. Indifference maps are a way to represent graphically the subjective 
preferences of a pol icy •-maker, rather than the objective possi- 
pilities "of actually being able to produce goods at a certain rate. 
In Figure 5-2 what would happen if the maximum production of high- 
way maintenance and health care is plotted at the intersection of 
2 and 3 units? Which of the three Indifference curves would ex- 
press the most realistic preferences? 
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5. To what extent do pdl icy processes in the private sector actually 
involve single policy actors? What factors present in postiri- 
dustrial policy environments might make distinctions between the 
"public" and "private" less convincing than in previous periods 
of history? 



List examples of specif 4^ goods , collective goods ^ and quasi- 
c^T 1 ect iv e goods . Who are the primary beneficiaries of the goods 
you have listed?^ 



List exampl es of con ectlve ^qoo ds^ produced i n the private^ sector, 
Naw list examples of spec4f4c-goods produced in the public sector. 
[Mint: Think about the controversies over the role of the Federal 
Communications Cornnission and the U.S. Post Office] 



In analyzing the butcbnes of community health care the analyst 
might use cost-benefit or cost-effectiveness analysis. Provide 
examples of measures of be^^efits and effectiveness, respectively. 
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9. In a flood control project farmers. and owners of railroads and 
trucfcfhg firms may have a hfgh wflHrigness to^ pay ^ expressed in 
terms bf the monetary value of ^pehditures th^y would. make (if 
they could) in order to save crops and maintain agricultural pro- 
duction. In a federal job retraining project, however, it is hot 
so easy to measure gross benefits in tenns of willingness to pay. 
Why are the two projects so different? 



10. Shadow pricifig is a way to find a "surrpgate^ for market prices 
(a surrogate is a kind of ''stand-in'^ for something el se) . What 
problems might arise in estimating shadow prices of social 
security, health, welfare, and a clean environment? 



2E4 

X.5.19 



PUBLIC POLICY ANALYSIS 



COMPONENTS OF POLICY RECOMMENDATION 



In the preceding section we reviewed six sets of questions that 
the policy analyst must ask and answer in order to make policy re- 
cbninendatiohs. Now we will explore in more detail several specific 
components of policy recaiinendation: objectives, constraints, exter- 
nalities, time, and risk and uncertainty. 

Objectives, In explicitly defining objectives the public policy analyst 
is acutally seeking a way to measure ^oc tauL wel f a re — i . e , , the collective 
sense of satisfaction experienced by members of a community. In general 
there are five types of social welfare: 

1. Individual Welfare^ The pol icy analyst may attach value 
only to individuals, thus ignoring societies, cbrntjunities, 
region?, or groups. Here the objective is to maximize 
the welfare of individuals. Without reference to other 
individuals who may lose. The analyst Who estimates 
welfare by attaching value to the. preferences of in- 
dividual businessmen specifies welfare in individual 
terms. 

2. Total Welfare. _The policy analyst may attach values 
to all individuals, attempting to maximize the wel- 
fare of everyone simultanedusly. For a variety of 
reasons public policy decisions do not permit every- 
one to benefit at once. The maximization gftgtaT 

welfare is impossible in principle, since_somegne_will 
always lose from a particulardecision regarding the 
production of collective goods ( Arrow^5-IroDOS^4MTlty 
Theorem ). 

3. Minimum Welfare. The analysthere attCTpts to maximize 
welfare such that at least one_indivjdual gains, while 
no person loses. This approach employs the Pareto 
criterion, which states_that one social state Isbetter 
than another if at least one-person is better off, and 
no one is worse off . _A Pareta-optimum is a social state 
in which it is not possible to make any person better 
off without making another person worse off— i.e. , 

we have reached the "limit'' in increasing social welfare. 
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4. Net Welfare, The analyst seeks to rnaxlrn^ net welfare, 
defined as gross benefits to some persons minds gross 
costs to others. If the gains outweigh the losses, 
then social welfare is maximized. This approach is 
identical to the net efficiency benefits approach to 
cdstrbenefit analysis discussed above. The central 
problan with this approach is that it overlooks con- 
siderations of distribution (e.g., of income) in society. 

5. Distributive Welfare . In cases where it Js possible 
to define net -efficiency benefits the analyst may 
still wish to measure benefits that result from a 
more equitable distribution of income or resources 

in a cbrSnunity. Publ ic programs (e.g. , income maintenance) 
sometimes yield zero net-efficiehcy benefits, yet re- 
sult in a better distribution of income among members: 
of acbnmuhity. One way to establish redistributibhal 
benefits is to measure the net benefits to the group 
to which the analyst wishes to redistribute income. 
In Table 5.1 below we compare net-efficiency and re- 
distributional benefits among two groups (local business- 
men and the urbah poor) in two hyjabthetical programs. 
Program II is the best choice, givehthat the objective 
is to maximize redistributional benefits to the urban 
poor. Note that Program II also results in zero riet- 
efficiency benefits for the community and a net loiss 
of $400 to businessmen. 



TABLE 5-i 

domparisbh of Net-Efficiency arid 
Red istr4^ut4 ^a1 B enefi ts for T^-Prbigranis- 



Program 


Targets 


Benefits to 


ebsts to 


Net-Effieiency 
Benefits 


Redistributional 
Benefits 


I 


Businessmen 


$1000 


$9oe 


5100 


NA 




Urban Pcdr 


500 


300 


2BB 


200 




Total 


15BB 


1200 


300 


20B 


II 


Businessmen 


SOB 


900 


-400 


NA 




Urban Poor 


1000 


600 


400 


400 




Total 


1500 


1500 


d 


400 
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NOTE: NA = not appl icabl e. Given that the objective is to redistribute 
income among the urban poor, redistributional benefits are not 
relevant for businessmen. 
SQUReE: Fictitious, data. 2SB 
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The policy analyst— hd matter what criterion of social welfare (s)he 
uses-^u St somehow find a way to define objectives. In this context it 
is especially important to distinguish goal^s from objecti ves . While 
public goals and objectives each set forth the aims of government in 
terras which are clearly defined* outcome oriented, and specific to 
particular programs (empldymeht, health, welfare, etc.), goals and ob- 
jectives differ in important ways. Goals, for example, are usually 
not measurable in quantitative terns, while objectives are— the goal 
of a maintaining a healthy population i? not the same as the objective 
of reducing infant deaths per 1,060 live births. Essential differences 
between goals and objectives are siannarized in Table 5-2 below. 
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TABLE 5-2 
Comparison of Goals and Objectivies 



Basis 


Characteristics 


of 

Comparison 


Goals 


Objectives 


Similar 


1. 
2. 


Terminology clearly 
defined 

Dutcome oriented 


1. 
2. 


Termihdlogy clearly 
def i ried 

Outcome oriented 





3. 


Program specific 


3. 


Program specific 




1. 


Not measurable 1n 
quantitative terms 


1. 


Measurable in 
quantitative terms 




2. 


Partially 

v^pcf a u 1 villa 1' 


2. 


Fully operational 




3. 


Extensive cross- 
departmental 
impact 


3. 


Limited cross- 
departmental 
impact 


Different 


4. 


time peridd 
unspecified 


4. 


time period 
specified 




5. 


Linked to problems 
characteristic of 
most jurisdictions 


5. 


Linked to problems 
characteristic of 
specific jurisdiction 




6. 


Broad purposes 


6. 


Specific aims 




7. 


Identify broad 
target population 


7. 


Identify specific 
target population 




8. 


Developed at 
highest levels 
v?ithin policy 
structures 


8. 


Developed at 
intermediate and 
lower levels within 
po1 icy structures 



One particularly important contrast between goals and objectives is 
the organizational level at which they are defined. ^ Goals tend to be 
developed at the highest levels within policy structures, and are therefore 
more general than specific objectives generated at lower level s--e.g. ^ 
within operating programs within public agencies. The relation between 
goals and objectives and levels within policy structures is illustrated 
in Figure 5-5. \ 
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Goals 




Objectives 



FIGURE 5-5 



The Relation Between Goals And Objectives 

Afld-Leve^^- th j n- PoUcyStnictu^res 



Constraints , After a policy analyst has defined objectives in 
bperatianal terffiSi it is necessary to consider possible limitations 
to their attainment. In addition to constraints present in the form 
of limited or finite resources— -which we reviewed above in terms of 
ideas of relative scarcity, trade-offs, and opportunity costs— thir^ 
are at least six additional factors which may limit the attainment of ob- 
jectives and reduce the feasibility of particular policy alternatives. 

1. g&ysical Constraints. Desired outconies may be limited 
by the state of development of knowledge and technology, 
as when public health programs are constrained by 
Inadequate knowledge and techniques for diagnosing and 
treating eomnuriicable diseases. 

2. Legal Constraints . Public law, property rights, and 
agency regulations can limit the feasibility of possible 
alternatives.- Legal constraints often decrease social 
welfare, as ^ for example, wheri reporting requirements 

of federal agencies place an unnecessary burden of 
paperwork and "red tape" on programs designed to pro- 
duce better services for the public. 
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3. Adffll hi strati ve Constraints . The iraplemeritatioh of 
public programs requires skilled personnel to ad- 
ministerthem^ as well as organizations which function 
at high levels of ef^ctiveness. For example^ public 
programs with sound objectives and high benefit- 
cost ratios may never actual ly attain predicted levels 
of performance, largely because admi Si strati ve 
constraints seriously impede the implementation of 
alternatives. 

4. Political Cohstraints . Oppdsitidn to public programs, 
as well as the desire to maintain processes of decision- 
making in their present fdnn* may serve as a serious 
cgnstraiht on the acceptance a<s well as implementation 
of given prograins. For example, the_ enactment and 
application of legislation to cdhtrdl the pdllutidn 

of the physicial envirdnment (alr^ water^ sound) is 
severely limited by processes of "ihcranental*' decision- 
iiialcing--i.e. , chddsing alternatives which differ as 
little as possible from the status quo in order to 
maintain political consensus. 

5. [VTStnbut4Qr(arl- Constrarirvts ^ Public programs, such as 
those concerned with social security, unemployment, 
and job retraining, are often established to m^^ 
net-efficiency as well as redistr benefits. 
The redistribution of income ma attaiment 
of oyectives of overall ecqnOT^^^ (e.g., rising 
per capita income), and vice versa. 



6. . Budgetary-Constraints^ Government budgets are limited, 
thus requiring that objectives be considered in the_ 
context of scarce financial resources. Fixed budgets 
create_type_I problems for policy analysts, who are 
often obliged to_maximi2e benefits within the limits 
of available resources. 

In considering budgetary constraints one of the key problems 
faced by the policy analyst is to determine whether (s)he is dealing 
with a type I, 11, or III jDroblem. The use of two conmon measures of 
social welfare--vi2. , net^enefits and b^ef ft^cost rat ios - -i s directly 
determined by whether we are dealing with fixed budgets or fixed outputs. 
A common problem faced by the policy analyst is whether to use the net- 
benefit or benefit-cost ratio approach to measure the benefits df alter- 
native programs. In Table 5-3, for example, three alternative progranis 
are compared in terms of benefit-cost ratios arid net-benefits. Using 
the net benef^it approach the analyst would recommend Program III, since 
it produces the greatest riet benefits. By contrast. Program I is the 
preferred alternative using the benefit cost ratio approach, since it 
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yields the highest ratio ov benefits tb costs- Two general rules may 
be followed in choosinq be:.iv^n the two approaches: (1) If there is 
a fixed budget but ho constraints on the number of projects which may 
be undertaken, use th-? benefit-cost ratio approach, in Table 5-3, 
for example, the analyst might be limited to 40 units of costs to 
achieve maximum benefits. In this case the analyst would recbirmend 
that Program I be repeated 10 times^ since this would yield the highest 
ratio of benefits to costs (10 to 1). (2) If there is no fixed budget, 
but the analyst must choose drily brie of three mutually exclusive pro- 
grams, the net-benefit approach should be used to reconmend Program III. 

TABtE 5-3 

. Comparison of Net-Benefit and Benefit-Cost 
Ratio Approaches^^r4'ji ree Programs ^ 



















Benefit-Cost 




Program 


Benefits 


Costs 


Ratio 


Net-Benefit 


1 


4b 


4 


id 


36 


II 


64 


8 


8 


56 


III 


100 


40 


2.5 


60 













SOURCE: Zeckhauser and Shaefer (1963:73) 



Externalities . Externalities are sirnificant side effects or spillovers 
which result from public programs. One of the important questions for the 
analyst is whether particular factors are "internal" or "external" to the 
problem. A simple example of firiancial externalities and internal i ties is 
provided below in Table 5.4, which shows total, external, and internal costs 
of alternative delivery programs for maternal care. If all three programs 
were equally effective (a doubtful assumption) the analyst at the state 
level would have no difficulty iri recommending Program I, since it requires 
only 10 percent of total costs to be paid by the state. Here the analyst 
would be taking into account a significant "external ity"— i.e. , federal 
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cost-sharing. At the same time if Program II is more effective than Program 
HI, but Program I is least effective, >he analyst would riot be able to 
choose simply on the basis of the state share (48.3%). In this case the 
arialyst may wish to look at the total costs of the two programs, re- 
conmending project II because its higher level of effectiveness justifies 
added costs to the state of $11 per patient (i.e, $96-85 = $11), Note 
also that what is an optimal recommendation at the state level may not be 
so at the federal level. If all programs are equally effective the policy 
analyst at the federal level will reconmend Program III because its 
total costs are lowest. 

TABLE 5-4 

TotaK Externa^U-and- interrial 
Costs of Alternative Delivery 
(costs per patient) 



I 


Program 


Gost Category 


I 

Maternal and 
Infant Care 
Project 


n 

Neighborhood 
Health 
Center 


III 
Private 

MD 


Total Cost 


$313 100% 


$199 100% 


$175 100% 


Federal Share 
("externality") 


282 90 


103 51.7 


90 51.7 


State Share 
( "internal ity") 


31 10 


96 48.3 


85 48.3 



SOURCE: Adapted from Burt (1974:35) 



In general, there are four kinds of external effects of spillovers 
to which policy analysts should be sensitive (Hinrichs and Taylor, 1972: 
18-19): 
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1. Prbduetion-td-production sp^-Uo^ei^s:: the eutjJUts of . 
one program often affect the outputs of ahdther pro- 
gram, asi for example, when successful alcohol isni arid 
drug treatmertt programs result in a decrease of law 
enforcement activities. 

2. Productidri-td-consufflPtiCT spillogecs^ : the outputs 
df a program Sdmetimes affect the qual i ty of goods _ 
or services consumed by the public, as when publicly 
funded highway projects displace residents from their 
hdmes and disturb the natural environment. 

3. Cdnsumption-to-cqnsumpUon-spj41overs : the cdrisumptidn 
activities df public programs -affect the corisumption of 
Citizens, as where the erection of a large government 
office building in a downtown area ma Res it impossible 
fdr local citizens to find adequate parking. 

4. Conisympt4wtg»pF5ductton- spi 1 1 overs : the Cdnsumption 
activities of public programs affect the production 
activities of other public and private prpgrams, as 
when the location of a government agency in a particular 
area improves the market for local businessmen. 

In making policy recdnmeridations the analyst should attempt to take 
each of these types of externalities into accdunt. Exterrtali ties—whether 
positive or negative in value— can have impdr<-«fjt implications for the 
validity of any pdlicy recommendation. 

Time. The policy analyst must carefully incorporate considerations 
of time into the choice of policy alternatives. Considerations of time 
are important for two main reasons: (1) the value df costs and benefits 
is not constant— it will change in future years; and (2) the short-term 
and long-term effectiveness of a policy may be quite different. 

In cost-effectiveness analysis we may use fixed outcomes (equal- 
effectiveness) dr fixed costs (equal-costs) as a basis for comparing and 
recommending alternatives. Gost-effectiveness analysis— as distinguished 
from cost-benefit analysis-does not seek to estimate "social welfare" on 
the basis of income. Gbst-iffectiveness analysis, rather, attempts to 
measure the attainment of objectives in nori-monetary units--e.g,, units of 
service, quality of goods, value of activities, etc. Whether the artalyst 
is measuring pffectiveness or beriefits, howeVir, (s)he musf take time 
into consideration. Thus, for example, a cost-effectiveness analysis of 
health care programs will yield radically different recommendations, 
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depending on the number of years included in the analysis. Table 5.5 
shows that the effectiveness of a comprehensive community health care 
program increases over time. After a period of five years the new pro- 
gram would result in a substantial improvement of key effectiveness 
indicators^ as compared with the baseline rates without the hew program. 
Note, however, that estimates of effectiveness in the first and second 
years are zero or negligible. 
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TABLE 5-5 

Estimated Effectiveness of Comprehensjm 
Coimiunity Health Care Prograni Over a Five^Year Period 



Indicator of Effectiveness 


1st 
Year 


2nd 
Year 


3rd 
Year 


4th 
Year 


5th 

Vear 


Total 
5 years 


Baseline Rate 
Without Program 


Estimated Rate 
After 5 Years 






Hospital days saved 


0 


0 


4,006 


7,006 


10,500 


21,500 


1,370/1,000 


9tw 1,000 


Hospital admissions averted 


0 


0 


286 


350 


500 


1.050 


140/1,000 


120/1,000 


Emergency rddiii visits averted 


0 


156 


356 


500 


500 


1,566 


146/1,666 


120/1,000 


Disability days averted 


















—Restricted activity 


6 


26,600 


50,666 


86,666 


112,000 


274,000 


22/year 


17.6/year 


—Bed disability 


G 






56,660 


63,000 


164,066 


10/year 


7.5/year 


—Work loss 


e 


19,e9G 


26,080 


30,600 


40,066 


100,060 


8/year 


6.4/year 



SOURCE: Adapted from Burt (1974:32) and Department of Health, Education, and Welfare. Bel i very of Health Services 
for the Poor (Washington, D.C: ii.S. Government Printing Office, December, 196717" 
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The policy analyst who is using either cdst-effectiveriess or cost- 
benefit analysis must take time into consideration in another way--vi2., 
by taking into account changes in target populations who will be served 
by a particular program. A psductioh in the target population over time 
may resulc in significantly lower costs, as v/ell as higher estimates of 
effectiveness. If ria?i*!tfi effectiveness indicators are measured on a per 
1,000 population basir- {e.g., hospital days averted per 1,0QG) and the 
total ;:arge*: population decreases, then measures of effectiveness will 
show an increase in attaining objectives. If, on the other hand^ there 
are differentic: i r^tes of change among different segments of a target 
population, cost ihd effectiveness measures Will vary- Thus^ for example. 
Table 5.6 shows that program targets in upper and middle income groups 
will decline over the 1977-1982 period^ while program targets in the lower 
income category will increase rapidly. 



TABLE 5-6 

Projectioii of Target Population 
( in thousands ) 



Population 






Y^ar 






1977 


1978 


1979 


! 1980 


1981 


1982 


Total 


400 


395 


389 


382 


371 


354 


—Upper Income 


40 


39 


38 


37 


36 


35 


—Middle Income 


280 


266 


251 


235 


219 


199 


--Lower income 


80 


90 


100 


110 


120 


130 



When thw analyst attempts to measure benefits and costs in mon- 
etary terms a whole new set of problems arises. When time enters the 
analysis it is necessary to recognize that a dollar has a specific value 
only on a spec^'^^ic date. At a 5 percent interest rate, yesterday's dollar 
is worth $1.05 today, $1.1025 tomorrow, and $1.1576 the day afte^ that. 
Similarly, tomorrow's dollar is worth only $.95 in today's real money value. 
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since monetary values are generctny a function of time. In effect, future 
benefits and costs should not treated as equal in value to present 
benefits and coiJts. (Dne my to estimate today's value of future costs 
arid benefits is to anploy discouritnig- ^-i .e. , a procedure whereby the 
monetary value of future costs and benefits is reduced to the n^-present^ 
value of benefits . In order to "discbunt" benefits to their present value 
analysts often use the soc4al-rate-Qf d4 scowt , which is simply a measure 
of the present value of benefits after an appropriate rate of int^irest 
has been applied to the reduction of tr.eir future value. For example, 
$1G0 of 1978 eniploymerit benefits derived from a manpower training program 
will be worth $95 today (in 1977), assuming that money is losing its value 
through inflation at a rate of 51 per annum- ths ctifficulty with the 
social rate of discount and other precec*ures* is : >ar, ; Is extremely 
difficult to select an "unbiased" discount rat^s. Should tie rate of 
discount be obtained on the basis of current bank interest rates? Interest 
rates on government bonds? Or should certain benefits (e,g,, health, 
clean air, public safety^ not be discounted so heavily (if they are to 
be discounted at (=^11)? In other words, it is difficult to put a price 
tag on public goods, arid even more difficult to estimate their inoietary 
value over time. 

Interest rates_usiially are important but there may be no 

one correct rate* The rate or rates to use depend on 

changing times , capital productivity, objectives, benefits 
and costs included and excluded in the analysis ,_and the 
level of optimization. Once m^ answer rests on the 

initial determination as to how badly one wants consumption 
or investment, now or later, in the public or the private 
sector (Hinrichs and Taylor, 1972:23). 

Ri s k - a n d -Uncertainty . In a world of complete certainty the policy 
analyst *s estimates of costs ana benefits--or costs and some rion-morietary 
measure of effecti veriess--would be "error free." that is the analyst 
would be absolutely (100 percent) right in his or her forecasts about the 
outcomes of alternative courses of action. In the world of the practicing 
policy analyst, however, risk and uncertainty are always present. Policy 
problems under risk are those in which the analyst is able to define margins 

♦These other orocedure^* including "internal rate of return" and 
"net terminal valu^," zrt discussed in Pearce (1971:35-51) and Zeckhauser 
arid Shaefer (1968:84-92). 
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Of error. For exaiiiplei the analyst itiay know that the projected dutcdmes 
of Program I are likely to occur 99 percent of the time (there is, therafdre 
a 1 percent chance that the analyst Is wrong). Policy problems under 
uncertainty are those where the analyst knows that (s}hc will be wrong a 
certain percentage of the time, but does not know what that percentage 
might be. For example, the analyst might be : 5, IG, or EG percent of 
the time. In dealing with uncertainty the ai;' • nas several options: 
(1) to choose alternatives with the smallest possible loss ( minimax ) ; f2) 
to choose altern tives with the minimum possible gain (>2ax4mn_); (3) to 
discount future benefits more than future costs; and (4) to use a more 
limited t'me period for the comparison of program alternatives, thus 
eliminating some of the unknown effects of time and an uncertain future. 
Whichever procedure is used (and there are other options) the analyst 
must take risk and uncertainty into account, since most policy problems 
are by no means "well -structured" ones. In fact, many of the most important 
problems are either "simply s+ructured" (thus permitting procedures for 
dealing with uncertainty) or "ill -structured." In t e latter case the 
problem is not to adopt the appropriate procedure ror dealing with risk 
and uncertainity, but to- define the nature of tne problan itself. 



11. Public policy problems are artificial, subjective^ dynamic, and 
inr'inite. What problems does this raise for the task of con- 
vert^ing goals into specific policy o' ^tives? 



12. The cdllection.of information has its costs. For this reason the 
Gornnissioh on Federal Paperwork was established_in 1975 to report 
on the value and burden of federal reporting requirements. To 
What extent should the collection of information be regarded as 
an "externality?" 
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13, List examples of problen tyjjes I, II, arid III iri' policy analysis. 



14. Provide examples of each of the ways to specify social welfare 
described in the text. 



15. An o H^tive f^jnctkin is a mathematical expression which shows 
thi^' f ' iation between an objective to t : inaxjmlzed and Its com- 
vm:o?ts? (the objective to be maximized is called maximand ). 
* vr ; lowing maximand is based or. the Pareto criterion: 

ZiW; ^d. 

{wj of ainy Individual (1 )_most be equa' to or greater 
than zero (i.e., nobody loses) 

If the_total income of the United States coritlriaes to increase 
at a rate of approximately 3.1 percent^ arid the Pareto eriterion 
is actually applied, what will the consequences be for the dis- 
tribution of income in the couritry? [ Hint : Thirik iri terms of 
the cumulative distribution of income and a Lorenz curve] 



16. List several examples of policy goals and pol icy^dbjectives in 
areas of envirormiental policy, crime policy, or health policy. 



2SV 



POLICY ACTIONS 



17. Are con str a j n t s a 1 ways an impediment to the making of "rational" 
policies? Provide examples. [ Hint : Think in terms of pu51ic 
personnel policies, environmental policies, etc.] 



18. What is the relation between constraints and the feasibil i ty of 
policy recommendations? 



19. List several examples of external ities in a policy issue-area of 
your choice. 



20. How do various forecasting approaches (intuitive, theoretical , 
extrapplative) help in different ways to deal with problems of 
time in making policy reconmendations? 



21. Provide examples of recommendations made under conditions of risk 
and uncertainty . 
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SYSTEMATIC ANALYSIS: STRENGTHS AND LIMITATIONS 



The use of systematic procedures for making policy recommendations, 
as stated in the introduction to this Uniti can have a variety of positive 
effects on the resolution of policy problons. If the analyst is able 
to state preferences explicitly^ it will be easier for the public to 
scrutinize public programs, since in this way the goals and objectives 
of polie^mafcers become clear. Second, the careful consideration of 
alternative course, of action available, to resolve a problem assists 
greatly in answering questions about What works best under different 
conditions. Lastly, systematic procedures for relating preferences to 
alternatives is the essence of informed choice, no matter how we might 
define *Vational ity. " In other words, there are some compelling arguments 
w^jich mav ^ -^rHe in behalf of the systematic analysis of alternative 
courses ^ 

\se for systenatic analysis, however, should not be overstated, 
since there are many limitations associated with the use of such techniques 
as cost-benefit and cost-effectiveness analysis (Rivlin, 1971:56-60; Hinrichs 
and Taylor, 1972:13-15). Some of these limitations derive from the 
techniques thenselves, while others sten from the ways in which techniques 
are used. 

1. Mistaicinrj-output for impact . In measuring the objectives 
of public programs it is important to distihguisn outputs, 
(e.g.* units of health care) from impacts (e.g. , reduction 
of disease)^ To confuse outputs and_impacts is to mistake 
mere activity with the 'achievement of goals. 

2. Copfuiifiq instrumental and _cdnsuntnatory vaTues^ . In 
setting objectives it is often the case that one end 
can also serve as a means to another end, which itself 
can be a means to another end, and so on. Butthere _ 
are certain kinds of objectives which are valuedin and 
of tfianselves— i.e. , they are not valued as "instruments," 
bat as something to be "consumed" because of their intrinsic 
value. If, incidsntally* such consunmatory objectives 
(e.g.. maintaining open democratic processes) also serve 

as a means to some other objective, (e^g., efficiency), so 
much the better; but consummatpry objectives such as 
dOTbcracy will nevertheless not_be_traded for efficiency. 
Hence^ the analyst should recognize that the £roeess_ 
of making recdrfinendations may be more important than 
the recomnendations themselves. 
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3. M4 ftaJc4na-w^tJiods-foP-5olutjon5. TRe use of particular 
methcds of analyslscan distort resalts of making It 
possible to accept only Information that can be ex- 
pressedqaantltatlyely. A superficial precision at- 
tajned by using quantltntlve tecfinlques TO^ 
the exclusion of factors* or considerations (e.g;, life 
satisfaction, happiness, justice, beauty) which are 
essential for recommending an appropriate solution, 



4. Ig4iorjng-chanqes^n-objectxyes^ The objectives of 
public policy are not static; through bargainirig^ con- 
flict, and compromise objectives may be generated over 
time^ debated, and redefined; . The lacfe of precision of 
objectives may not always be a sign of confusion or 
inaction^ but rather ah indication of the vitality of 
pol icy processes; 

5. Seal izihg multiple objective s. In a large number of 
cases public policy analysts^seek to attain several 
objectives at the same time. There may be trade-offs 
between net efficiency, redistribution of iricdrne* and 
the maintenance of existing social institLjtions--as, 
for example, when a promising industrial developent 
prbject is likely to benefit the wealthy more than the 
poor, whose local community will _ be shattered by the 
location of hew factories. Siinllarlyi "a high benefit- 
cost ratio dri a bridge CO ir -'.-iP^ two wealthy suburbs 
and financed by general sal J^: (:ax revenues may not be 
directly comparable td a lower benefit-cost ratio on 

a bridge between two pdor comrnunities financed by a 
progressive iricdme tax'* (Hinrichs and Taylor, 1972:14). 

6. Hisapplicatidri df economic logic, "EcpnqmistSj" it 
has b^eh observed* "know the price of everything and 
the value of ridthihg." This statement pglnts to the _ 
problem, frequently encountered in cost-benefit analysis, 
in which the_easiest benefits to :measure_are increases 

in income.. The use of income measures, to evaluate the 
benefits of various kinds of social problems ie.g; , 
health* welfare* pre-school education, OTployme^^^ 
implies that the goal of _ increasing national income 
"is mdre important than good heal thor better ed- 
ucation or the elimination of poverty, and that these 
other goals ai^ legitimate_only to the extent that 
they increase future income" (Rivlin, 1971:56), 

7. Ignoring be)mv4oral^-prQcessei. The policy analyst, 
no matter how successful (s) he may be in estimating 
benefit-cost or cost-effectiveness ratios, may have 
little knowledge of theactual impact of programs 

on the behavior of targets; The calculation q-f costs 
and benefits of training_prbgrams for the tiaenployed, 
for example, may be based on very little informatidn 
about how trainees will actually respond tc training. 
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For this reason numeroas cr of cost-berief 1t_ analysis 
have proposed that systematic social experimen 
be undertaken prior to committing largeamoants of 
funds to programs whose behavioral consequences canribt 
be estimated through cost^benefit ratios. In other 
words, cost-benefit analysis is! imi ted in its capacity 
to predict the future behavior of target populations 
as well as program administrators and staff. 

This review of strengths and limitaitions of sy:tamatic procedures 
for making policy recomnendations would be incomplete if it did not 
point but that recorSnehdatioris, by their very nature* occur prior to 
policy action, yet there are many uncertainties associated with policy 
action, and it is clear that analysts cannot foresee all possible out- 
comes in advance. For this reason, increasing attention has been devoted 
to procedures for systematically mdriitdring and evaTuating policies after 
they have been rpcownended. In the next unit we shall return to monitoring 
and evaluation as procedures which permit the analyst to compare fore- 
casts and reccmniendations with the ongoing experience of policy formation 
and implerentation. 



[^22. Some commentators believe that procedures of policy recommendation 
j are "ethically neutral." Considering the strengths and limitatibhs 

of systematic procedures reviewed in the text, db you agree? Why? 

Why not? 



23* "A question well-stated is a question half -answered." Discuss. 
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ASSIQNMENTS 



T^,lnk carefully aBoat a public prbbl an with which you are familiar. 
Write a short brief ing -paper (6^10 pages) which might be used as a basis 
for convincing policymakers that they should adopt a jsartlcular course 
of action. Include in your briefing paper a discussion of major analytic 
components (objectives, constraints, externalities , time^ risk, uncertainty) 
of the problem. The most efficient way to Write this paper is to consider 
the steps outlined in Figure 5-4 (but make sure to discuss each relevant 
component at each step). The organization of your paper should be based 
on the following headings: 



I. 


The Policy Problan 


li. 


Policy Seals and Objectives 


HI. 


The Target Population 


IV. 


Pol icy Alternatives 


V. 


Comparison of Policy Alternatives 


VI. 


Policy Recommendations 



Finally, you should note that this assignment is not a dif f icmI .no, 
but it does call for some creativity in applying what you have learrc- 
far to a problem of your choice. 
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INTRODUCTION 

The ultimate aim of jDdlicy analysis is to provide valid information 
about the performance of pol icies— i -e- , to evaluate policy outcomes so 
that We are able to tell whether needs and values have been satisfied 
through public action; No matter how "rational" a policy alternative may 
appear before action is taken, the ultimate test of a policy's performance 
is "the degree to which policy outcomes evaluated after action is taken 
actually satisfy human needs and values. 

the necessity of monitoring and evaluating the consequences of public 
action may seem obvious. Nevertheless, there are many cases of public 
policymaking where policy analysts place primary or exclusive reliance on 
methods of rational choice (i.e., recdrnmendation) , with little or no 
attention to methods for systematically generating experience in the course 
of policy implementation. In the words of one student of policy processes: 

One of the amazing weaknesses in much contemporary public 
policymaking is that there is no systematic learning from 
experience. Very few evaluations of the real outcome of 
complex issues are made, and there are even fewer oh which 
imprdvemerits df future policymaking can be based . . . 
In spite df the common tendency_to "justify _action in terms 
of ."experience^" the simple fact is that learning from 
experience is accidental and sporadic (Dror, 1968: 275). 

The central argument of this unit is that the use df pdl icy analytic 
procedures of monitoring and evaluation can improve information about policy 
perfdrmarice and contribute to the development of pdlicies which better satisfy 
human needs and values.^.. Althdugh the use of systematic monitoring and 
evaluation procedures does not guarantee better policymaking— and in fact 
may even confuse issues as much as it clarifies them (dones, 1970: 110)— 
monitoring and evaluation are two of the essential procedures employed by 
policy analysts. 

in this final unit we shall examine in greater depth: (1) the role of 
evaluation in providing information about policy performance; (2) selected 
approaches available to evaluate policy dutcdmes; and (3) strengths and 
limiatatiohs of policy analysis as an intellectual activity which is embedded 
in social and political and technical information for policy development. 
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LEARNING OBdECTiVES 

After completing this unit you should be able to: 

1. Compare and contrast policy analytic procedures of monitoring and 
evaluation. 

2. Define and characterize aspects of policy performance. 

3. List the functions of evaluation in public policy analysis. 

4. Distinguish the four main types of evaluation agents. 

5. identify major components of a general strategy of evaluation. 

6. List the major requirements of program evaluation. 

7- identify three important sources of error which threaten the vali- 
dity of information about policy performance. 

8, Gompare and contrast the four major approaches to evaluation- 

9, Distinguish between the external and internal validity of results 
of experimantal evaluations. 

10. Compare arid contrast different types of policy cycles. 

11. Identify major factors whichinfluence the utilization of infor- 
mation about policy performance. 

. ^ , " 
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KEY TERMS AND CQNeEPTS 



• 


Monitoring 


• 


Intended arid Uriiriterided Impacts 


• 


Evaluation 


• 


History 


• 


Policy Performance 


# Maturation 


• 


Evaluation Agent (s) 


• 


Instabil ity 




Proximity 




Formative Evaluation 


m 


Gompositioh 


• 


Summative Evaluation 


m 


"Dileima of Proximity" 


• 


Direct (Experimental) Controls 




Level of Perfdrmarice 


m 


Indirect Controls 


• 


Scope of Performance 


m 


Developmental Evaluation 




Efficiency of Performance 


m 


Experimental Eval uation 


m 


Policy Objectives 


• 


Retrospective Process Evaluation 


m 


Policy Preconditions 


• 


Retrospective Outcome Evaluation 


m 


Policy Actions 


• 


Policy Cycles 


m 


Policy Events 


• 


Information (Knowledge) 






Util ization 


m 


Policy Outputs 






m 


Immediate and Secondary 







Impacts 
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EVALUATiON ANB PGtlCY PQLICY PERFOf^MANCE 

When the policy analyst Has successfully moriitored the consequences 
of policy action s/he is in a position to evaluate policy outcomes. 
Monitopinj , as we have seen, involves descriptions of present or past 
act1on--i .e. , factual premises, ivaluatiofr , by contrast, involves the 
application of certain standards of valui to present or past action— i .e. , 
value premises. Since all future consequences of public policies cannot 
be foreseen in advance, it is necessary to employ systematic procedures 
of monitoring and evaluation. Given that policy recommendations are sub- 
ject to varying degrees of risk and uncertainty, some systematic procedure 
for determining pel icy perfdnnance must be employed in order to obtain 
information as to whethir needs and values are being met through public action. 

fhi term evaluation has several related meanings, each of which refers 
to the application of some standard or scale of values to outcomes of policy. 
Evaluation is synonymous with appraisal, rating, assessment, and judgment, 
words which denote attempts to apply some set Of values to policy or pro- 
gram Outcomes. When policy outcomes result in the achievement of objectives 
we say that some level of pdl icy perforttiance has been attained, which may 
also mean that p&Ucy^oblems^ have been resolved or at least amel iorated. 
For example, high policy performance may be present when target groups 
receive services (outputs) or when targets actually experience changes which 
are part of the objectives of a program (Impacts). Such performance is 
evident when the sick and aged not ohiy receive adequate health care, but 
also experience reduced rates of illness as a result of medical treatment. 

Evaluation performs a number of essential functions in public policy 
analysis. Evaluation: (1) reveals the extent to which-objecti ves have 
been attained; (2) explains why objectives were or were not attained and why 
prbbleire were or were not resolved;* (3) identified discrepancies among dif- 
ferent perceptions of needs and values; and (4) provides a basis for several kinds 



♦Strictly speaking, the explanation of policy processes is accomplished 
through monitoring (see, Unit 3). At certain points, however, monitoring 
and evaluation overlap with one another, particularly since one is a pre- 
requisite of the other. For this reason Caro (1971 : 23) and others use 
m term "quasi-evaluation" to describe certain procedures which we have 
described as monitoring. 
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of decisions associated with policy development, Including the identification 
of "new problems and the continuatidni termination ^ and ddjustment of policies 

Criteria of evaluation may be formaU as in those eases where precise 
units of measurement (e.g., dollars) are used; but criteria may also be 
hoh-formal , as when general assessments (e.g., simple statements of relative 
worth) are made in written reports or the press. Finally, criteria may be of 
different types of rationality (economic, technical ^ legal, social, sub- 
stantive). Thus, for example, the same Gomnuhity Action Program may be 
evaluated in terms of criteria of economic efficiency (economic rationality), 
criteria related to the maihteharice of democratic processes (social 
rationality), or both (substantive rationality). 

Evaluation agents are the individual or corporate actors who actually 
engage in efforts to assess the performance of public policies and programs. 
Evaluation agents differ along two major dimensions: their prox i^nity to 
processes and their compos tti on . Evaluation agents who are closest to 
policy processes are usually internal to the organization in which policies 
are made (e.g., agency directors), as cdritrasted with external agents (e.g., 
journalists) who are not directly involved in policy formation. Likewise, 
some agents are individuals (e.g., congressmen), while others are so-called 
institutional actors ^ such as the General Accounting Office (GAO). Four 
types of evaluation agents are illustrated below (Table 6.1). 



TABLE 6-1 
Four Types cf- E^al-ua tion Agents 



1 

Composition 


Proximity to Policy Process 


Internal 


External 


Individual 


Agency Heads 
Members. of _ Congress 
Agency Employees 


Academic Researchers i 
Journalists j 
Citizens j 

I 


Institutional 
Actor 


— 

Office of Agency 
Pol icy Analyst 
Presidential Commissions j 
Office of Management 
and Budget (0MB) 


— 1 

University Research ! 

Groups 
Private Research 

Institutes 
bobbies 
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Oisti notions among types of evaluation agents are important for a 
number of reasons, all of which are connected with questions about the 
influence of evaluators in shaping policy formation- Internal evaluators, 
for example* may share one or more of the following advantages (Caro, 1971: 
17; Willianis and Elmore, 1976): (1) more thorough knowledge of the or- 
ganization and its policies and programs; (2) an institutional base for 
continuous monitoring arid evaluatiori activities; and (3) opportunities 
to influence policymaking directly, either as individual or institutional 
actors responsible for policy analysis activities within a given organization. 
On the other hand, external evaluators may possess advantages Which internal 
evaluators do not share. External evaluators (1) are often able to maintain 
a greater degree of objectivity; (2) frequently employ criteria of evaluation 
which serve to question basic assumptions of policies; (3) are not so directly 
dependent on organizational resources to carry out their tasks; and (4) 
may have a more accurate picture of the values and needs of target groups 
than internal evaluatiori agents. There is, of course, a "dilenrna of 
proximity" j i what has been described above. Institutional actors who are 
most proximate to policy processes may be least capable of carrying out 
objective^ critical, and constructive evaluations of public policies. Gori- 
versely, external evaluation agerits may have more to contribute to the creative 
formation and adjustment of policies, yet lack irifluerice precisely because 
they are not directly irivolved in policy processes. 

No matter how close or far away from policy processes are agents of 
evaluation, their primary aim 1s to provide iriformatiori about policy 
performarice. Policy performance refers to the degree to which policy 
outputs result in policy impacts. For example, if the imprdvemerit of 
health care for the aged is a policy objective, and the provisiori of low 
cost or free medical service is a policy output (measured in terms of units 
of treatment)* then inforntation about policy performance may be obtained 
by comparirig outputs with impacts (measured in terms of the incidence of 
chronic diseases). In this context there are at least three major questions 
relevant to the determi nation; of policy performance: 

1. bevel of Performarice . How strong is the relationship 
Betweeri policy outputs and policy impact? Forexample, 
does the provision of med1cal_seryices to the aged 
(outputs) result in a large, moderate, or small_re- 
duction in the incidence of chronic disease (impacts)? 
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2. Scope of Performance . Given_any level of performance 
[high, moderite. Tow) how many persons in a target 
group in need of medj^cal services actually receive 
and_benefit from them? For example, is a reduction 
in the incidence of cfironic disease experienced by 
alU most, or only a small pbrtioh of persons within 
a target group? 



3. Efficiency of Performance . How much does it cost to 
provide a given level of perfbrraance? Are ther^^ 
alternate prbgrams which can provide the same aut-_ 
puts and impacts at lower ebst or with less effort? 
Ob programs with higher levels, of performance fail to 
produce cbmparable gains in the scope of perfdrmance? 
Are programs with ±he highest level and scope of per- 
fbrmahce more costly or less costly? 

A general strategy of evaluation has at least six interrelated components 
(cf. Cook and Scioli, 1972; Suchman, 1967), These components and their 
interrelationships are illustrated below in Figure 6,1. 
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Policy (Program) Objectives . This consists of defining 
operational indicators of the specific changes in policy 
ehvirdrimehts that policies or programs are designed to 
produce. For example^ increased access to outpatient 
care might be one of the operational indicators of db- 
jectives sought by a corrinuhity health care program 
designed for low- income persons. 

Policy (Program) Precdhditidns . This refers to th| social , 
political i and ecdndmic cdnditidns under which a given 

policy dr program targets (e.g.* average education^ 

awareness df program) and policy actors (e.g^, community 
leaders* support df_dppdsitipn to the program in a 
given context have to operate 



Policy (Program) Actions * This component consistS-of 
inputs of expenditures , personnel J and equipm^ as well 
as processes such as behavioral patternsof program staff, 
interactions with clients, and_ the authority structure 
(e.g^ , central izedvs^ decentralize control) through 
which activities are carried out. 

Policy (Program) Events. This cbmfjonent refers to 
events that may occur from the time at which policy 
action is initiated to the time at which monitoring 
and- evaluation-activities take place. Unforeseen events 
(e^g., a strike by public employees, a highly contested 
election^ sudden refjorts of fraud and misuse of public 
funds] may intervene between policy actions and policy 
outputs and impacts, such that it is difficult dr im- 
possible to determine whether any given level dr scdpe 
of performance is due to the policy or program^ dr to 
unanticipated events. 

Policy (Program) Outputs . This cdmpdnent includes actual 
services or goods received by a target population as a 
result of policy actions undertaken over time. Policy 
outputsraight include units of health service, hours of job 
counselling, units df dispensed medicine, and miles of 
paved streets. 

Policy (Prdgraitv)— Impacts . This component refers to the 
actual changes in the targets of policies and programs. 
Policy impacts might include rates of new _employmeht, the 
incidence df illness^^and reduction_of car repairs and 
accidents. Policy impacts may^e broken down according to 
time--i.e., some irapactsare immediate (e.g., improved 
Heatth care) and some are secondary (e.g., increased 
productivitydue to improved health care). Further , .pdl icy 
impacts^may be analyzed-in terms of predictabil ity- -i .e. ^ 
some impacts are intended (e.g^, productivity resulting 
from health care) and others are unintended (e.g. ^ ^ increased 
passenger loads on municipal buses due to a healthier and 
more active population). 
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The purpose of making these interrelated cdmpdnents explicit is to 
emphasize the essential difficulty in employing procedures of evaluation 
to determine policy perfdrmance: the pdssible conseqLences of pdlicy 
action are complex, many-sided^ and- 4j£fi cult to assess — they are by no 
means self-evident . For this reason various components cannot be viewed 
separately, but must be analyzed as interdependent parts of an entire net- 
work of relationships (see Figure 6.1 above). 

The evaluation of policies and programs occurs after particular actions 
have been undertaken. The requirements- of pbl icy-prbgram evaluation, 
however, are similar in most respects to those questions asked by policy 
analysts in making policy recommehdatioris (see Unit 5). 

The main difference is one of t i me- - r ecdmrtien da t i on invdlves statements 
about the future, while evaluation involves statements about the past and 
present (see Unit 1* Figures 1.9 and 1.10). 

Errdrs in the interpretation df public policies can be best illustrated 
by eampbeIVs (1969) analysis of a 1955 crackdown on speeding in the state 
of Cdnnecticut. A recdrd high df traffic fatalities in 1955 prompted then- 
Soverhor Abraham Ribicoff to formulate a new law ehforcemerit pdlicy prdvidihg 
for a severe crackdown on speeders. One year after the new policy had been 
in force there were 284 traffic deaths * as cdmpared with 324 in the previdus 
year. Interpreting the performance of this new policy Governor Ribicoff 
arihouhced: "With the saving df 40 lives in 1956, a reduction of 12.3% from 
the 1955 motor vehicle death toll, we can say that the program is definitely 
worthwhile." these results are displayed below in Graph 6.1. 
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And After New baw Enforcement Policy 
SeURGE: Gampbell (1969) 



There appear to have been some beneficial consequences of the 1955 
policy. Nevertheless, the S6vern6r*s interpretation of policy performance 
failed to take into account several irnportant sources of error which 
threaten the validity of interpretations: 

1. History, A number of events can occur between the 
time a policy is instituted arid the pdirit at_which 
outcomes are measured.: In the case of the_1955 policy 
these_events might include usual ly favorable weather 
conditions (e.g., little rain or sridw) arid more 
exterisiveiuse of auto safety devices (e.g. ^ seat 
belts). Each of these everits represents a plausible 
rival interpretatiori of the causes of the 12.3 
percent reduction in f^l ities. 
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2 Matar^tTdh . ehariges over time in the characteristics of a 
target popolatioh might alsoaccount for observed differences 
before and after a policy. In this case drivers might well 
have "matured," in the sense of becoming more cautioos and 
responsible, perhaps as a long-term consequence of driver 
education in schocls and public information provided by the 
mass media. 

3. Ihstahility - Changes in a target population or policy 
environment might be irregular and unstable, rather 
than smoothe and continuous, as in secular trends tsee 
Unit 3). Time series are often unstable^ and the degree 
of instability in this case might well invalidate inter- 
pretations of policy performance. 

The same data from Graph 6.1 has been displayed below as part of our 
extended time series (Sraph 6.2). Thi presentation of this new data compels 
us to reinterpret the 1955 Connecticut law enforcement policy and its 
claimed high level of performance. First, there are many events which 
may have occurred in the history of implanenting thi policy, each of which 
could invalidate assessments of performance. We could analyze weather 
information and seat belt sales, for example, so as to determine whether 
there were significant changes over time. Second, target groups may well 
have matured as a result of public educational programs, although the 
collection of such information presents real difficulties. Niverthel ess , 
we can still speculate on the effects of maturation, given that death 
rates are in fact going down year after year, relative to the number of 
automobiles and miles driven. Finally, the changes in death rates between 
1955 and 1955 may be part of an instable time series. In this case we 
do in fact find very pronounced irregularities over the period of 1951-59^- 
suggesting that the actual consequences of thi 1955 policy were relatively 
unimportant or trivial. The data in Graph 6.2 illustrates that the 
Governor's assessment of policy performanci was prone to errors of in- 
terpretation. 
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STUDY QUESTIONS 



Gbmpare and contrast monitoring and evaluation in terms of time 
and the nature of statements produced by each procedure. 



List the major functions of evaluation in public policy analysis 
and provide illustrations of each. 



What is the "dilemma of proximity" and how might it be resolved 
through new organizational arrangements? 
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4. How are the four types of evaluation agents related to the 
di lemma of proximity? 



5. "If the level _of_perfgrmarice_of_a 
safe to assumethat Its scope and 
high." Is this statement a valid 



given ppjicyiihighj then It Is 
efficiency of performance are also 
one? Why? Why not? 



6. How many different combinations of elements _of compdnents listed. 
In Figure 6.1 are possible? Note that the first component (Pol Icj^ 
Obiectlves) has three elements {Q.i Og* O3J. f Hint : MultipTy_the 
number of elements in the first cSnpdnent by elements in all the 
remainingcomponents] , If each of the elements listed under 
Policy Impacts is divided into four subtypes* as in Figure 6.1, 
how many combinations will there be? [Answers: 729, 2916] 
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7. What are the main similarities arid differences between task? 
necessary for making policy recommendations (Unit 5) and major 
requirements of program evaluation? 



8, Recent reports have emphasized that the enforcement of federal 
erivirdrimerital protection legislation, while less than tbtally 
successful* has nonetheless resulted_in reasonably adequate levels 
of performance. Giventhat one of the major objectives of such 
policies is to reduce the vclume of pollatsSts produced by in-^ 
dustry^ which of the threats to the interpretation of _pol icy 
performance (history, maturation, instability) might result 
in a reinterpretation of policy performance? Illustrate your 
answer. 
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APPROACHES TO EVALUATION 

Cdifipohents in our general strategy of evaluation are present in 
one form or another in most analyses of public policy. At the same time 
there are several different approaches to evaluation, each of which varies 
along two specific dimensions. The first dimension is represented by 
orientations toward policy processes: evaluations may be formative or 
suimiative . In formative evaluations, program implenehtatibh arid the 
monitoring of policy actions take place. concurrently , as contrasted with 
suninative evaluations, where monitoring arid evaluatiori activities are 
carried out at a specified point in time after programs are in force. 

To some extent this contrast is artificial , since the main dis- 
tiriguishirig characteristic of formative evaluatiori is the number of 
evaluation points between the initiation of a program and its outcomes. 
Hence, summative evaluatiori may be regarded as a special case of formative 
evaluation— i -e. , a case involving one point of tifSe. 

The second dimension is the nature of controls over policy action: 
evaluatibris may involve direct cdritrols over mariipulable policy inputs 
and processes, as distinguished from i^direcl cohtrdls in the form of 
statistical analyses of relations between policy actions and outcomes 
which have already occurred. In the former case, evaluatbrs cari directly 
manipulate expenditure levels, the mix of programs, and the characteristics 
of staff arid target groups— i.e., the evaluation sometimes has characteristics 
of a "controlled experiment-" In the latter case, however, policy actions- 
caririot be mariipulated directly; rather they must be analyzed retro- 
spectively on the basis of actions that have already occurred. Four major 
approaches to evaluatiori— each are based on a combination of these two 
dimensions— are illustrated below in Table 6.2. 
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TABLE 6.2 
tour Approaches to Evaluation 



Gontrbis Qver 
Policy Actions 


Orientation Toward Policy Processes 


Formative 


Summative 


Direct 


Bevelbpmehtal 
evaluatibh J 
XEdticatibnal 
Testing: .Sesame 
Street i Electric 
Company) 


Experimental 
evaluation 
|New Jersey- 
Penhsylyania 
Income Mainten- 
ance Experiment) 


Indirect 


Retropsective 
Process evaluation 
(Title I of the 
Elementary and 
Secondary Educ- 
ation Act) 


Retrospective 
Outcome evaluation 
(The Coleman 
Report) 



Bevelopmental evaluation refers to evaluation activities which are 
explicitly designed to serve the day-to-day needs of program staff.. 
Developmental evaluation is useful "for alerting the staff to incipient 
weaknesses or unintended failures of a program and fbr insuring proper 
bperation by thbse responsible for its operation" (Rossi and Wright, 1977: 
21). Developmental evaluation, which involves some measure of direct control 
bver policy actions, has been used in a wide variety of situations in the 
public and private sectors. Thus, for example* businesses have traditionally 
used developmental evaluations to distribute, test, and recall new products, 
in the public sector develbpmental evaluations are frequently used to test 
hew teaching methods and materials in public. education programs, such as 
Sesame Street and Electric Company- Such prbgrams are systematically mdnitbred 
and evaluated while shown to audiences of children within specified age 
limits. Subsequently, they are "revised many times on the basis of systematic ob 
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servations of which program features achieved attention and oh the basis 
of interviews with the children after viewing the programs" (Rossi and 
Wrights 1977: 22). Developmental evaluations, since they permit direct 
control over policy actions, can be used to adapt to new experience 
acquired through systematic mahipulatiohs of input and process variables. 

Retrospec t4A/e process evaluation involves the monitoring and evaluation 
of programs after they have been instituted. Retrospective process evaluation, 
which often focuses on problems and bottlenecks encbuhtered in the implementation 
of policies and programs, does not permft the direct manipulation of inputs 
(e.g., expenditures) and processes (e.g., alternative dislivery systems). 
Rather it relies on ex post facto (retrospective) descriptions of ongoing 
program activities, which are subsequently related to outputs and impacts. 
Retrospective process evaluation requires a well established internal re- 
porting system which permits the continuous generation of program- related 
information (e.g. , the number of target groups served, the types of services 
provided, and the characteristics of personnel employed to staff programs). 
Hahagement ihfbrmatibh systems (MIS) in public agencies sometimes permit ret- 
rospective process evaluations, provided they contain information' on processes 
as well as butcbmes. Title I bf the Elementary and Secondary Educatibri Act (1965) 
was subjected to a form of retrospective process evaluation by the office 
of Educatidh, but with disappointing results. Title I provided funds to 
local school systems in proportion to the number of pupils from poor or 
deprived families. Local school districts, however, submitted inadequate or 
marginally useful information, thus making it impossible to engage in efforts 
to evaluate and Implement programs concurrently. The main problem with ret- 
rospective prbcess evaluations is that they presuppose a reliable and valid 
infonnation system, which is difficult to establish. 

Expe^rimen t a l eva J^ati^n refers to the evaluation of outcomes of 
policies and programs under coriditibns bf direct cbntrbls over policy 
inputs and processes. The model for experimental evaluation has generally 
been the ''cbhtrdlled scientific experiment,'* which several notable academic 
and governrneht spokesmen have urged be adopted in policy settings 
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(e.g., eampbell, 1969; Rivlirii 1971; Fairweather, 1967). the basic idea 
of experimental evaluation is that a1 1 factors which might influence policy 
outcomes except one— i.e. ^ a particular input or process— are controlled 
or held constant (i.e., they exert no effects on policy Outcomes).* A 
substantial number of experimerital evaluations have been carried out as 
part of public policymaking efforts. Thise include the New Jersey- 
Pennsylvania Income Maintenance Experiment; the California Group Therapy- 
Criminal Recidivism Experiment; the Kansas City Preventive Patrol Experiment; 
Project Follow through; the Supported Work Demonstration Project; and various 
experiments in educational performance contracting (cf. Rossi and Wright, 1977). 

Experimental evaluations must meet rather severe requirements before 
they can be carried out (cf. Williams, 1971: 93): (1) a cltarly defined and 
directly manipulable set of "treatment" (i.e.* in pit and process) variables 
which are Specified in operational terms; (2) ah evaluation strategy which 
permits maximum general izabil ity of conclusions about performance to many 
similar target groups or settings ( exterga^l validity ); (3) ah ivaluation 
strategy which will likewise pennit minimum errors in interpreting policy 
performance as the actual result of mahipolated pOlicy inputs and processes 
Mhterhal validity ); and (4) a monitoring system which produces reliable data 
that can.be used to measure complex interrelationships among objectives, 
preconditions, actions* events, outputs, and impacts (see Figure 6.1 above). 
Since these demanding methodological requirements cannot always be met, ex- 
perimental evaluations fall somewhat short of the "true" control lid experiment. 
In addition, experiments with human subjects sometimes raise ethical issues, 
which make experimental evaluations Infeasible or simply undesirable. 



♦Experimental evaluations include various distinctions (e.g.* "quasi- 
exoerimental" and "pre-experimental " evaluations), depending on the number 
and types of input and process variables included in the analysis and on 
the degrie to which target groups or situations are selected randomly 
{i.e., according to the rule that every target has ah equal chance or bevng^ 
selected]. See Riechen and Barouch (1974) and Sattentag and Struening (1975J 
for a fuller elaboration of differences. 

312 



POhieV perforkanace 



Retro spectoj^e-outco rne evalu ations also invdive the mbriitbrlhg and 
evaluation of outcomes^ but with no direct control over manipulable policy 
inputs and processes.* At best controls are indirect or "statistical "—i.e. ^ 
the evaluator attempts to isolate the effects of many different factors by 
using advanced quantitative methods. In- general , there are two main variants 
of retrospective process evaluations: crbss-sectional and longitudinal studies. 
Longitudinal studies are those which evaluate changes in the outcomes of one, 
several, or many programs at two or more points in time; before-and-after 
studies typically use two points in time, as contrasted with time-series 
analysis (see Unit 3), which uses mult'fple points in time as a basis for 
evaluation. The most frequent longitudinal studies have occurred in the 
area of family planning, where fertility rates arid changes in the acceptance 
of contraceptive devices are monitored and evaluated over reasonably long 
periods of time (5-20 years). Cross-sectional studies, by contrast, seek to 
mdriitdr and evaluate multiple programs at one point in time--i.e., after a 
policy or program has been implemented, the major goal of the cross-sectional 
study is to discover whtether the outputs and impacts of various programs are 
significantly different from one another; and, if so, what particular actions, 
precdnditioris* or events might explain the difference. Two prominent examples 
of retrospective outcome evaluations that are cross-sectional in nature are Project 
Head Start, a program designed to provide compensatory education to pre- 
school children, and the Coleman Report (see Unit 1). Indeed, "almost every 
evaluation of the national compensatory education programs started during the 
middle 196Qs has been based oh cross-sectional data. Pupils enrolled in 
compensatory education programs were contrasted to those who were not, holding 
constant statistically such sources of competing explanations as family 
background, ethnicity, region, city size, and so on" (Rossi and Wright, 1977: 
27). 



*Note that three of the approaches to monitoring discussed ihUnit 3-- 
i.e., social accounting, social auditing, and social research cumulatidn-- 
may also De considered, as forms of retrdspective dutcome evaluation, provided 
they go beyond descriptions and actually apply standards df value to monitored 
outcomes. Siirtilarly, cost-benefit analysis (see Unit 5). may also be viewed 
as a form of retrospective outcome evaluation, as well as a systematic 
procedure for policy recoimiendation. 
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STUDY QUESTIONS 

What is the main distinguishing characteristic of formative 
evaluations* as compared with summative ones? 



10. Why are formative evaluations also called "process," "con^ 
current," or "developmental" evaluations? 



11. Ah "experimental treatment" is a policy input or process which 
can be manipulated directly by policymakers. How would you 
describe a "non-experimental treatment?" 
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12. What is the role of time in determining the choice of an 
approach to evaluation? 



13. Which of the four major approaches to evaluation is probably 
of most direct utility to policymakers in highly complex and 
rapidly changing policy environments? 



14. What is the difference between interna! and external validity? 
' Why are questions of internal and external validity important 
for public policymakers? 
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15 As a pdlieyniaker cdricerhed with the development of the most 
cost-effeetive health care delivery programs, you have just 
received a rejsort that a field experiment in Pehhsylvama pro- 
duced remarkable changes in the improvement of health care. _ 
Assuminc that you are confident that this high performance is 
actually the result of the experimental program— and given that 
your interest is in developing a national system of health care 
delivery-^which of the two types of validity would be of imme- 
late concern? 



16 Which of the four main approaches to evaluation is most appro- 
priate for determining the economic and technical rationality 
of a policy or orogram? Which is most appropriate for , , 
determining social rationality? Substantive rationality? (Note: 
You may wish to review Unit 1) 
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INFORMATION UTILIZATION AND POLICY DEVELOPMENT 

Although the ultimate aim of the policy analyst is to provide valid 
iriformatibri about policy performahee, the question still arises as to how 
such information is actually utilized by. policymakers. Policy-analytic 
procedures of evaluation play a Rey role in transforming information about 
policy outcomes into knowledge that tells us whether needs and values are 
being satisfied through public action. Nevertheless ^ it is not enough 
simply to provide information; information must also be utilized for 
purposes of making jDdlicies which actually contribute to the resolution 
of public problems. 

Let us now return to several distinctions considered in the first 
Uhit--i.e.r distinctions between policy, analysis ^ policy formation , and 
pol icy -Processes , Policy analysis, as we Rave seen, is a rational in- 
tellectual activity which employs multiple methods to monitor, forecast, 
recommehd, and evaluate public policies. Policy formation ^ by contrast ^ 
is a rational intellectual activity embedded in a dynamic social, political, 
arid orgariizatiorial environment. The process of formulatirig arid i^nplementing 
policies thus includes: (1) inte^4^ectuaX activities of problem ideritif icatidn , 
monitoring, foreeastirig, recbmmeridatibn , arid evaluatidri--i .e. ^ policy- 
analytic procedures which generate various types of information; 
(2) managerial activities associated with the formulatidri and implementation 
of policies through planning, staffing, organizing, cdritrdllirig, and directing 
operations iri the pursuit of organizational objectives; and (3) 40ci6poUtical 
activities associated with riegotiatidn, persuasiori, bargaining, compromise^ 
arid conflict, each of which promotes changes in policies over time. In other 
words, policy-analytic procedures are always applied in cbritexts where the 
utilization of information is significantly shaped by factors which are 
brgariizatidrial, social, arid political, and not merely methbdolbgical 
or tecRhical in nature. 

there are at least four potential ways that information about policy 
performance may be utilized fbr purposes of developing hew or better policies. 
Information about policy performance may be utilized such that: 

i. A given policy rnay_be_ adjusted to new conditions 
experimentally through monitoring and evaluation; 
This kind of policy ajj^tmeni-4:yc^ which results 
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in revised recqrrinendatTons, IS evident in a broad 
range of publicpolicjes which are modified over 
time by making budgetary shi^f^^ from one program 
category to another, or by making marginal in- 
creases (or decreases) in total budgets, 

2. Policies may_al so be cont^ modification 
as a-result of information that objectives are beimg 
successfully attained. This kiridof policy support 
or continuatioh cycle is evident in programs where 
minimal objectives are attained, but with no sig- 
nificant modification in target groups, types of pro- 
grams, or personnel- 

3. Policies may also' be terminated altogether, either 
because of information that the original problem 
was solved, or because the pi3licy created more 
problems than it resolved. Such tenri nation cycles 
are rare, although the repeal of legal prohibition? 
against the sale arid cdnsumptiori of alcoholic beverages 
iri the 1930s provides one leading example of a 
termiriatidri cycle. 

4. Finally s information about policy performance may 
result in the identification of new policy prpblems_. __ 
Here an. entirely new set of objectives and alternatives 
may be part of a new problem i den^i ft' cat i on cycl e . 
Perhaps the best illustration of 4 4entifica ^ofl-cycles 
comes from the area of housing policy. A study carried 

: out by the Rand Corporation in the middle 1960s was 

originally intended to evaluate and make recommendations 
on the costs and benefits of new housing units. ^^B^ 
the time the evaluation was finished^ however, the _ 
original problem {creating new housing_unTts) was dis- 
carded in favor of a new one: how best to upgrade 
the quality of existing units through federal arid state 
subsidies to landlords. 
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FISURE 6.2- 
pQlicy Cycles 




Pol icy 
Outcomes 



Policy 
Performance 



Pol icy 
Al ternatives 




' Adjustment Cycle 
D Continuation Cycle 



^ Termination Cycle 
Identification Cycle 



These four types of policy cycles are illustrated above in Figure 6.2. 
The particular type of cycle -evident in any particular case will depend in 
large part on the degree to which ihformatiah about policy perforniance has 
been utilized by policymakers. For example, policymakers may accept or re- 
ject irifbrmatioh which indicates that a policy should be adjusted to hew 
circumstances, or terminated altogether. This may occur despite the fact 
that performance might be improved through adaptations, 

this failure to utilize irifdrmation provided by external and internal 
evaluatioh agents, who might be either individuals or institutional actors, 
is one of the major problems of policy development in modern public or- 
ganizations. 
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A number of important factors influence the util izat^gn^ of j^orfflatiofl^ 
(policy informational Components) acquired throagh the application of 
particular methods (policy analytic procidures) in policy settings. Following 
bur cdriciptidn Of policy formation and implementation as a prbciss composed 
of intellectual, managerial, and sociopolitical activities, factors which 
influence the utilization of information may be divided into several 
broad types which involve: (1) the specification of objectives; (2) the 
selection of appropriate approaches to evaluation; (3) political feasibility; 
(4) time constraints; (5) the distribution of political influence; (5) the 
fonn and content of information; and (7) the characteristics of policy- 
makers. 
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1. Speci f i cati on of Obj ecti ves . The major problems of : 
evaluating policy Outputs and impacts are "vague goals, 
strong premises, and weak effects" (Rossi and Wright, 
1977: 9). Very Often the absence of consensus on 
clearly defined goals and objectives results in a 
dismissal of information about policy performance. 
Advocates of various social programs established in 
the late 1960s * for example, often set forth strong 
claims that vaguely defined programs would be (or 
were) effective in resolving problems of illiteracy, 
unemployment, poverty, and social inequality. This 
combination of strong promises and ambiguous goals 
contains the major implications: first, the dem- 
onstrated consequences of policy actions are likely 
to be weaker than advocates claims; second, any 
procedure for monUoring and evaluating policy and 
program outcomes must be highly sensitive to small 
ch;an§es in outputs and impacts (Rossi arid Wright, 
1977: 10). Small or marginal chariges iri outputs 
arid impacts may be very important^ a reduction of 
the unemployment rate by 0.1 percerit will affect 
some 80,000 persons; a change of drie or two points 
in the Gini Index of Inequali^ty may mean that 
thousands of ^families in lower income groups will 
be able to meet their basic rieeds; a small change 
in treated illnesses may result in tens of thousands 
of dollars of new income through more productive 
employment. The specificatiori of objectives (e.g^ , 
a 1.5 percent change in uriemploymerit rates) ^provides the 
major standard of value or need against which policy 
outcomes are evaluated. Objectives must not only 
be clearly specified; they must also be partially_ _ 
acceptable to policymakers. Sometimes, while defining 
objectives in operational tenns, internal or external 
evaluators (but especially the latter) ^depart from 
definitions held by policymakers. In doing so they 
risk the alieriation arid ppposition of key decision- 
makers and other irifluential parties. 
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S€tec-t4grv ^f-Appropriate Approaches . Selecting the 
appropriate approach to evaluation (e.g.* retrospective 
versus expertfnental or develdprnehtal evaluatidris) may 
be critical for detecting small but important changes 
in policy outcomes. Conversely ^ the approach to evalu- 
ation may also be essential fbrdetectihg large but 
unimpdrtant changes, as we sawabbve in the time series 
aoalysisof law erifdrcemeht policies in Connecticut 
(Graphs 6.1 and: 6.2). Nevertheless, if a particular 
approach to evaluation fails to produce information 
consistent with that of policymakers , valid resul^ts 
raay.be rejected_by_program advocates on the claim_that 
some-Other approach was moreappropriate; In this 
context it is important to note thatstrategies of 
monitoring and evaluation which are dynamic or proces s - 
ori en ted-- i^e: J those which para n in important 
ways many of the characteristics^of- developmen 
eyaluation--appear to result in greater utilization 
of information than static or outcome-oriented 
strategies (van de Vail and Bolas, 1975), 

Political Feasibility . Irrespective of their 
methodological strengths and limitations, different 
approaches to evaluation may lack political feasibility. 
In other words, technical or methodological issues 
are often also political ones. Thus * for example, 
developmental and experimental evaluations cannpt 
be used with prdgrams that arealready established 
and ruhnihgiSince it is usually hdt pdssible td 
devise new alternatives over which there. is direct 
cdritrdl in the middle of a program's implemehtatidh. 
Further^ developmental and experimental evaluations 
typically seek to withhold "treatment" (e.g., social 
services) from a control group: (e.g. * groups of a 
target population with particular characteristics). 
This raises political and ethical questions which 
may^well make retrospective evaluation the only 
acceptable course of action, despite the fact that 
it may be inappropriate from a methodological point 
of view; 

Time Cdnstraihts . Thdrbugh and systematic evaluations 
may require years of effort. At the same time policy- 
makers typically require: that infbrmatibri about policy 
perforraahce be made available within much shorter- 
periods of time, usual ly within one year or less be- 
cause of annual budget preparations. Time constraints i 
together with problems of political feasibility^ may 
require a less than appropriate approach to evaluation. 
For example, a simple before-and-after retrospective 
outcome evaluation might be employed instead of a time 
series analysis |see Sraphs- &;1 jind &.2) ^ w^^ predi^ctable 
results in thefpnn of threats to t^ 
external validity of information about policy per- 
formance. ^01 
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5. Ajstribotion of Political Iriflaence , Even where ihfor- 
mation about policy performance is highly valid, and the 
choice of ah^evaluation approach bptlmaU there are 
impbrtant political obstacles to the utilization. 

of infbrniation. The author of the vyell-knbWn Coleman 
Repbrt, fbrexample, has generalized the importance 
of pblitical factors in_ obstructing the utilization 
of information about policy butcbmes (Cblefnarli 1974). 
First: "the greater the lateral distance between the 
problem-fbnnulatbr and the decision maker* the more 
lilcely the research results will be irrelvant to the 
decision maker's problem." Second: "Research results 
seldom travel a greater distanpi. up an authority system 
than the point at which the problem was originally 
formulated-" While these generalizations are primarily 
applicable to external evaluation agents , especially 
university- based social scientists working under con- 
tract With gbvernmeht agencies, they appear to have^ 
more widespread applicability to relationships between 
pblicymakers_and each of the four types of evaluation 
agents (see Table 6,1). 

6, Form and ^ontrnt^of^lftformation^. The form and content 
of information about policy performance can also exert 
a decisive influence on the degree to which results 
will be utilized |van de Vail and BoTas, 1975);- Thuf , 
for example, _it has _been found that the longer_eval- 
uation reports are the lesi likely that their contents 
win be utilized by policymakers; an optimal length- 
appears to approach fifty pages^ Second, the use of 
terms and concepts with a minimal level of abstraction 
(from thepoint of view of policymakers) is associated 
with greater utilization of information about policy 
performance. 

7.. Cha4^acte^stics of P^icymakers . A recent study of 
the utilization of social science knowledge by policy- 
makers at the- national level suggests that thef'e are 
several minimal cbnditibristhat must be present before 
information utilization will take place (Cap! an et al . 
1975). First, policymakers -must have a reasoned 
appreciation bfjthe scienti ficand extra-scientific 
aspects of a policy problem.. In this context policy- 
makers trained in law show less appreciation for 
scientific results, and hence IqwerleveTs^pf^ _ 
utilization^ than pdl icymakers trained in medicine 
and the social and natural sciences.. Second, the 
ethical and scientific values of policymakers must- _ 
reflect a sense of purposiveness andsocial responsibility, 
as evidenced in a sensitivity to contemporary events 
and a desire for social reform.^: Thirds from-the_ 
viewpoint of pbl icymakers information_must-conform 
to intuitive Understandings of problems and their 
sblutiohsi be perceived as objective in nature; arid 
must suggest policy actions that are deemed to be 
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politically feasible- Finally^ the utilization of 
infdnnation occurs more frequently when policymakers 
and agents of evaluation are linked by infonnatjon 
specialists who can convert results of monitoring 
and evaluation into policy goals and objectives. 

In conclusion, let us return to an idea with which we began our 
examination of public policy analysis (Unit 1): The ^jrocess of pblicv 
formatio n-and implementation cahhbt be adeguately rep «sented-^as-6ne which 
is or ought to be uhiversaJJ y reliant on methods of r ational choice (re- 
^ ornnendatip n^ ). Public policy analysis, properly understood^ places equal 
reliance oh methods of rational choice as well as methods of generating 
hew experiences in the course of action- Some policy analytic procedures 
are primarily useful as means for generating hew experience through problem 
identification, monitoring, and evaluation; others are important because 
they permit us to apply experience in the form of forecasts and recom- 
mendations. The use of all these policy analytic procedures as part of a 
dynamic strategy of public policy analysis is what is meant by a dia- 
lectical mode of rational choice. This dialectical mode is well -suited 
to problems which involve different conceptions of rationality (economic, 
technical, legal, social, and substantive); it also contrasts sharply with 
descriptive, prescriptive^ arid authoritarian modes, each of which has 
severe disabilities. Public policy analysis, conceived as a dialectical 
effort which employs multiple methods of iriquiry, can vastly expand in- 
fbrmatiori about policy processes in postihdustrial policy environments. 
Potentially, at least, it can also give us a better idea of how to 
convert knowledge into public actions which will better satisfy human 
needs and values. 



323 

X.6.33 



PUBtie PQlia ANAhYSlS 



STUDY QUEStiONS 

17. Provide illustrations frdm^ own experience of each of the 
four types of policy cycles. 



18- Policy problems are subjective, artificial i dynamic, inter- 
dependent, and infinite Csee Unit 2). What problems does 
this raise for the specification of objectives with which to 
evaluate policy performance? 



19- Imagine yourself in the role of an external _eyaluator. What 
steps would you take to o\?ercome each of the obstacles to 
utilization discussed in the text? 
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20« Consider the following statement: "Theory without action is 
sterile; action without theory is purposeless." What are the 
Implications of this stat«neht for public policy analysis? 



21. "Policy analysts have only interpreted the world; the real 
task is to_change it," How does this statement relate to 
prcblems of information utilization? 
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